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@ A multimedia authoring system uses a 
graphic interface display which is implemented 
as a part of a flow editor and is used to create 
and to program interactive multimedia presen- 
tations and coursework. The authoring system 
also includes other editors (e.g., a database 
editor, an expression editor, and an object 
editor) used to perform other editing functions 
required to create presentations. The system 
also includes control systems (e.g., an appli- 
cations mover, a videodisc controller, and a 
help system) which also enable the user to 
create, program, execute and manipulate in- 
teractive multimedia presentations. Finally, the 
system includes an e valuator which evaluates a 
programmed presentation and implements the 
presentation. A process of creating and evaluat- 
ing a presentation using selectable icons from 
an icon menu area of the display screen and a 
grid area of the display screen includes receiv- 
ing an input selecting an icon from the icon 
menu area, storing in the memory a data struc- 
ture associated with the selected icon, display- 
ing a new icon corresponding to the data 
structure on the grid area, and performing an 
action represented by an action identifier in- 
cluded in the data structure. 
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i. FIELD OF THE INVENTION 

This invention relates to computer authoring sys- 
tems and, more particularly, to a computer system for 
creating and presenting interactive multimedia pre- 
sentations and coursework. The invention facilitates 
the creation and presentation of interactive multime- 
dia presentations and coursework using a graphic in- 
terface display. This invention also relates to visual 
(or iconic) programming systems and, more particu- 
larly, to a visual programming system for creating soft- 
ware applications. 

II. BACKGROUND OF THE INVENTION 

Interactive multimedia presentations and course- 
work have become an important and effective method 
of presenting information and teaching. Additionally, 
the ablity to program computers has also become an 
important skill which can take years to develop and 
master. Therefore, conventional computer systems 
have been developed which address each of these 
items. However, no known conventional computer 
system addresses both of these items. 

A. Creation of Interactive Multimedia Presentations 

When people communicate with each other, they 
use many different methods to creatively convey infor- 
mation. Among these methods of communication are: 
sound/music, pictures, words, numbers, animated se- 
quences, and full motion video. The use of these 
methods in a presentation is typically referred to as 
the multmedia approach to communication. 

Historically, multimedia presentations have been 
encumbered by the use of multiple technologies, such 
as slide projectors, videotapes, and computer graph- 
ics. But today, powerful computers offer a single de- 
livery system or platform for integrated multimedia 
presentations. Thus, the speaker or teacher only 
needs to handle a single piece of equipment. The dif- 
ficulty then remains in how the speaker or instructor 
is going to create and present multimedia presenta- 
tions using these powerful computers. 

In addition to creating an environment for multi- 
media presentations, the computer has also made it 
possible to create interactive presentations which 
means that the viewer can actually participate in a 
presentation by communicating with the computer. 
This has given rise to a class of computer software ap- 
plications called courseware which is a powerful 
teaching and training tod. Again, the difficulty re- 
mains as to how the instructor is to create and present 
these interactive multimedia presentations. 

One conventional computer system provides a 
method for specifying and executing independent, 
multimedia tasks along a synchronized time-line in 
the form of a matrix with the event elements making 



up the rows and the time periods making up the col- 
umns. Although this conventional system addresses 
the issue concerning the time consuming task of cre- 
ating the presentation, this system fails to provide irrv 

5 portant interactive capabilities. Furthermore, this con- 
ventional system employs a time-line for the control of 
events in a presentation. Using a time-line requires 
the operator using such a conventional system to du- 
plicate events so that the events can be executed in 

10 more than a single time period. This requires addition- 
al computer resources which is not desirable. 

B. Visual Programming Systems and the Method of 
Visually Programming an Interactive Multimedia 
15 Presentation 

In general, programming may be defined as spec- 
ifying a method for doing something the computer can 
do in terms the computer can interpret or understand. 
20 There are many aspects of programming: the lan- 
guages and environment used for the specifications; 
the specifications themselves; the determination of 
whether the computer has executed a specification as 
expected; the display of data involved in the execution 
25 of the specification; etc. 

In the past, traditional programming systems in 
well-known or standard programming languages, 
e.g., FORTRAN or PU1 have been used to program 
computers. However, the problem with traditional pro- 
do gramming systems is that they require programmers 
to learn the cryptic statements and rigid structure or 
syntax used by standard programming languages. It 
is for this reason that icons have been used to replace 
the cryptic statements of standard programming lan- 
ds guages with visual programming languages to devel- 
op visual programming systems. 

Visual programming can be applied to all aspects 
of programming. The important issue is creating 
meaningful graphic objects involved in an aspect of 
40 programming. This is addressed in the creation of vis- 
ual programming systems. 

One example of a visual programming system is 
Pict which is designed to aid program implementation 
using computer graphics: With Pict, users sit in front 
45 of a color graphics display and communicate with the 
system throughout all phases of their work by pointing 
to icons in a menu tree. Pict permits the user to select 
images that visually represent the data structures and 
variables needed; to draw the desired algorithm as a 
so logically structured, multi-dimensional picture; to 
watch the program run; to see the results being gen- 
erated; and if the program isn't doing what is expect- 
ed, to see where and when the error occurs. Although 
Pict is a visual programming system having control 
55 structures for writing computer applications, Pict re- 
quires arrows or series of arrows to show the flow of 
an application. Using arrows to show the flow of an ap- 
plication is somewhat archaic, requires additional 
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computer resources, and is not necessary to depict a 
program flow. 

Although visual programming systems have been 
developed, these systems fail to appreciate the need 
to create a visual flowchart that symbolizes the logical s 
flow of the application (or presentation) being devel- 
oped. These visual programming systems also fail to 
concentrate on the flowchart metaphor to remove the 
tedium from program creation. These conventional 
visual programming systems fail to permit the pro- 10 
grammer to assemble pictures, brushes, sounds, 
speech, animations, music, video, text, and datafiles 
and control them interactively via a mouse, keyboard, 
touchscreen, or joystick. Therefore, a single visual 
programming system which addresses all of these 15 
shortcomings of conventional visual programming 
systems is desirous. 

III. OBJECTS AND SUMMARY OF THE 

INVENTION 20 

It is therefore an object of the present invention to 
provide for a computer system in which users can cre- 
ate multimedia presentations and course work. 

It is a further object of the present invention to pro- 25 
vide for a visual programming system in which users 
can create applications. 

It is still a further object of this invention to enable 
computer users to program interactive multimedia 
presentations using a visual programming system. 30 

It is yet another object of the present invention to 
provide a method for designing presentations using 
integrated computer technologies on a single platform 
that enables the user to input, create, manipulate, and 
output text, graphics, audio, and video utilizing a sin- 35 
gle-user interface. 

To achieve the objects of this invention and attain 
its advantages, this invention uses a graphic interface 
display which is implemented as a part of a flow editor 
and is used to create and to program interactive mul- 40 
timedia presentations and coursework. The present 
invention also includes other editors (e.g., a database 
editor, an expression editor, and an object editor) 
used to perform other editing functions required to 
create presentations. Furthermore, this invention in- 45 
eludes control systems (e.g., an applications mover, 
a videodisc controller, and a help system) which also 
enable the user to create, program and execute inter- 
active multimedia presentations. Finally, this inven- 
tion includes an evaluator which evaluates a program- so 
med presentation (or application) and implements the 
presentation. 

More particularly, in a data processing system 
having a memory and a display device having a dis- 
play screen, the display screen may include an icon 55 
menu area for displaying a plurality of icons and a grid 
area for displaying ones of the icons. The plurality of 
icons in the menu area includes a plurality of select- 



able icons each one of which is associated with an ac- 
tion identifier in the memory. A process of creating 
and evaluating a presentation using the plurality of se- 
lectable icons and the grid area includes, receiving an 
input selecting an icon from the icon menu area, stor- 
ing in the memory a data structure associated with the 
selected icon (the structure including the action iden- 
tifier for the selected icon), displaying a new icon cor- 
responding to the data structure on the grid area, and 
performing the action represented by the action iden- 
tifier included in the data structure. 

To also achieve the objectives outlined above, 
this invention uses a data processing system having 
a central processing unit, a memory, and a display de- 
vice, the display device has a display screen including 
an icon menu area for displaying a plurality of icons 
and a grid area for displaying ones of the icons. The 
plurality of icons in the menu area includes a plurality 
of selectable icons each one of which is associated 
with an action identifier in the memory. A process of 
creating a presentation includes receiving a first input 
selecting an icon from the icon menu area and storing 
in the memory a data structure associated with the se- 
lected icon. The structure includes the action identifier 
for the selected icon and a plurality of attributes char- 
acterizing the action identifier. The process also in- 
cludes displaying in the grid area a new icon corre- 
sponding to the data structure, and receiving and stor- 
ing a selection input indicative of the attributes of the 
data structure. The receiving and storing of selection 
input indicative of the attributes of the data structure 
may be performed by either (1 ) icon requesters which 
have a plurality of definable fields which correspond 
to the attributes associated with a data structure for 
the selectable icons, (2) an expression editor applica- 
tion which includes an expression editor window dis- 
playable on the display screen which window includes 
a plurality of definable fields which correspond the at- 
tributes associated with a data structure for the select- 
able icons, (3) an object editor application which in- 
cludes an object editor menu which has object editor 
options each of which corresponds to an identifier for 
a representative object stored in the memory which 
has object attributes, or (4) a video controller request- 
er which has a plurality of video controller options for 
defining a plurality of attributes of a data structure cor- 
responding to an icon. 

In another embodiment the process of this inven- 
tion is in data processing system and includes a cen- 
tral processing unit, a memory for storing a plurality of 
data structures corresponding to a presentation, and 
a display device. The display device has a display 
screen including a presentation area for displaying a 
presentation. Each one of the data structures includes 
an action identifier and a plurality of attributes. The 
process includes receiving a one of the plurality of 
data structures of the presentation, analyzing the re- 
ceived data structure to determine an action to be per- 
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formed in response to the action identifier of the data 
structure, and performing the action corresponding to 
the action identifier in accordance with a plurality of 
the attributes of the received data structure. 

To achieve the objects of another aspect of this 
invention and attain its advantages, this invention 
uses a data processing system having a first memory 
and a second memory. The first and second memor- 
ies are adapted for storing a plurality of presentations 
and a plurality of resources, and each one of the plur- 
ality of presentations includes a plurality of linked data 
structures which identify a plurality of resources each 
having a name. A process performed in the data proc- 
essing system includes receiving an input selecting a 
one of the plurality of presentations to be relocated 
from the first memory to the second memory, scan- 
ning the linked data structures of the selected presen- 
tation to identify the plurality of resources identified by 
the presentation, and generating a list of names and 
locations within the selected presentation corre- 
sponding to the identified plurality of resources. The 
process also includes renaming the names on the 
generated list, changing the names of the identified 
plurality of resources to the new names on the gener- 
ated list, and moving the presentation and the re- 
sources identified on the generated list to the second 
memory. 

The accompanying drawings which are incorpo- 
rated in and which constitute part of this specification, 
illustrate an implementation of the invention and, to- 
gether with the description, explain the principles of 
the invention. 

IV. BRIEF DESCRIPTION OF DRAWINGS 

Fig. 1 is a block diagram illustrating the compo- 
nents of an exemplary computer system or platform in 
which the present invention may be implemented. 

Fig. 2 is a block diagram which illustrates the soft- 
ware components of the preferred implementation of 
the present invention. 

Fig. 3 is an illustration of a flow window generated 
by the flow editor of the preferred implementation of 
the present invention. 

Fig. 4 illustrates the main icon menu 400 of the 
preferred implementation of the present invention. 

Fig. 5A illustrates the control icon submenu of the 
preferred implementation of the present invention. 

Fig. 5B illustrates the interrupt icon submenu of 
the preferred implementation of the present invention. 

Fig. 5C illustrates the data icon submenu of the 
preferred implementation of the present invention. 

Fig. 5D illustrates the wait icon submenu of the 
preferred implementation of the present invention. 

Fig. 5E illustrates the AV icon submenu of the pre- 
ferred implementation of the present invention. 

Fig. 5F illustrates the module icon submenu of the 
preferred implementation of the present invention. 



Fig. 6 illustrates the icon menu operational flow of 
the main icon menu and the icon submenus illustrated 
in Figs. 5A - 5F. 

Figs. 7A - 7D illustrate the relationships used by 
5 the preferred implementation to describe icons on the 
GRID of the flow-window of Fig. 3. 

Fig. 8 illustrates an example an icon requester us- 
ing the animation icon of Fig. 5E. 

Figs. 9A - 9B illustrate a block diagrams of an ex- 
10 emplary data structures associated with a presenta- 
tion created with the preferred implementation and 
which may be evaluated with the preferred implemen- 
tation. 

Fig. 10 Olustrates a block diagram of the flow edi- 
ts tor of Fig. 2 and the relationship of the flow editor to 
other components of the computer system of Fig. 1 
and the preferred implementation of the present in- 
vention of Fig. 2. 

Figs. 11 A - 1 1G are flow diagrams for the prefer- 
20 red implementation of the edit window handler of Fig. 
8. 

Fig. 12 is a flow diagram for the preferred imple- 
mentation of the icon requester handler of Fig. 8. 

Fig. 13 illustrates a preferred example of the ex- 
25 pression editor window displayed on the display 
screen when the user enters the expression editor. 

Fig. 14 is a flow diagram of the expression editor 
of Fig. 2. 

Fig. 15 illustrates a block diagram of the object 
30 editor of Fig. 2 and the relationship of the object editor 
to other components of the computer system of Fig. 
1 and the preferred implementation of the Present in- 
vention of Fig. 2. 

Figs. 1 6A - 1 6M illustrate flow diagrams of the ob- 
35 ject editor of Fig. 1 5. 

Fig. 17 illustrates a block diagram of the database 
editor of Fig. 2 and the relationship of the database 
editor to other components of the computer system of 
Fig. 1 and the preferred implementation of the present 
40 invention of Fig. 2. 

Fig. 18 is an illustration of the database window 
of the database editor of the preferred implementa- 
tion. 

Fig. 1 9 is an illustration of the key window of the 
45 database editor of the preferred implementation. 

Fig. 20 is an illustration of the edit database win- 
dow of the database editor of the preferred implemen- 
tation. 

Figs. 21 A - 21 C are flow diagrams of the preferred 
so implementation of the videodisc controller of Figs. 2 
and 8. 

Fig. 22 is a flow diagram of the preferred imple- 
mentation of the applications mover of Fig. 2. 

Figs. 23A - 23G are flow diagrams of a preferred 
55 implementation of the evaluator of Fig. 2. 

Fig. 24 illustrates a flow diagram of the authoring 
system of the preferred implementation. 
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V. DETAILED DESCRIPTION OF THE 
PREFERRED IMPLEMENTATION 

Reference wilt now be made in detail to the pre- 
ferred implementation of the invention as illustrated in 
the accompanying drawings. 

This invention is preferably implemented by a mi- 
crocomputer or other data processing system. Such a 
data processing system may be conventional, how- 
ever, the present invention is implemented in an Ami- 
ga microcomputer manufactured by Commodore 
Electronics Ltd. The architecture for and procedures 
to implement the present invention in the Amiga mi- 
crocomputer, however, are also not conventional, as 
they provide for an unique approach to the creation 
and execution of interactive multimedia presentations 
and coursework as well as to the programming of ap- 
plications software. The preferred implementation, 
which is disclosed hereinafter in functional schematic 
form, is written primarily in the C programming lan- 
guage. 

Referring to Fig. 1, the computer system or plat- 
form 100 is comprised of a central processing unit (or 
CPU) 102, a disk drive 105, a mouse 1 1 0, a keyboard 
1 1 5, and a display 1 20. The platform 1 00 may also op* 
tionally include other external devices 125, such as a 
videodisc system or an electronic instrument system. 

The CPU 100 is comprised of an input/output unit 
130, a random access memory unit (or RAM) 135, a 
display memory unit 140, a video interface circuit (or 
VIC) 145, and a microprocessor 150. These units are 
all well known and operate under control of the system 
software to process various inputs and provide the 
outputs necessary to generate desired textual and 
graphic display information on the display screen 122 
of the display 120 or other output unit such as the op- 
tional external device 125. 

Display memory 140 is a specialized section of 
RAM which is used to store bit patterns (pixel data) 
which are read out by the video interface circuit 145 
in an appropriate synchronization with the display 
beam of the display 120 in order to provide the desired 
display graphics and text. 

The disk drive 1 05 is also conventional and is pro- 
vided to permit the ready interchange of control and 
application software and to provide a source of mass 
storage for the computer system. 

The mouse 110 of the computer system 100 in- 
cludes a roller ball 111 and control buttons 112 and 
113. The buttons actuate momentary contact 
switches to generate selection signals and other com- 
mands. These switches and signals are well known 
and, as is also well known, the user moves the mouse 
110 along a planar surface, such as a table top, to 
generate cursor position input commands which are 
supplied to the CPU 102. The roller ball 111 cooper- 
ates with a mechanism which converts the movement 
of the mouse 110 into X-Y signals which are used by 



the CPU 102 to control positioning of the cursor sym- 
bol on the display screen 122 of the display 120. The 
conversion of the motion of the roller ball intox-y com- 
mands is also conventional. 

5 The keyboard 115 may replace the activities of 

the mouse 1 10 by presetting a number of keys on the 
keyboard to emulate the positioning function of the 
mouse. Additionally, other keys on the keyboard 115 
may replace the functions of the buttons 112 and 113 

10 of the mouse 110. However, in the preferred imple- 
mentation of the present invention, a mouse 110 is 
used for positioning the cursor on the display screen 
122 and for performing other functions described be- 
low. As is generally the case with conventional data 

15 processing systems, the keyboard 1 1 5 of the comput- 
er system 100 of the preferred implementation of the 
present invention acts as a means of inputting textual 
or alphanumeric information into the CPU 102. As 
stated above, the display 120 is comprised of a dis- 

20 play screen 1 22 for displaying the graphic and alpha- 
numeric information output from the CPU 1 02. In the 
platform 100 of the preferred implementation the dis- 
play 120 may be a touchscreen display in which com- 
mands may be entered into the CPU 102 via the dis- 

25 play 120. Such touchscreen displays are also conven- 
tional. 

Finally, in the preferred implementation of the 
present invention other external devices 125 may be 
connected to the platform 100 to participate in the 

30 execution of a presentation created by the user. Ex- 
amples of these external devices are videodisc sys- 
tems or electronic instrument systems. These sys- 
tems are also conventional and when connected to 
the platform 100 may be used to create and present 

35 multimedia presentations and coursework. 

A. The Major Components of the Preferred 
Implementation 

40 The preferred implementation of the present in- 

vention is comprised of several software components 
200 (Fig. 2) which would reside in the disk drive 105 
(Fig. 1). When the user employs the preferred imple- 
mentation of the present invention, all or part of the 

45 software components 200 of the preferred implemen- 
tation may be input to the CPU 102 to service the 
needs of the user. 

Fig. 2 is a block diagram which illustrates the soft- 
ware components 200 of the preferred implementa- 

50 tion of the present invention. The preferred implemen- 
tation is comprised of a flow editor 210, an applica- 
tions mover 220, a database editor 230, an evaluator 
240, an object editor 250, a videodisc controller 260, 
a help system 270, and an expression editor 280. 

55 When the preferred implementation is invoked or 

begins execution in the platform 100, the flow editor 
210 is the initializing component which provides for an 
editing environment which is supported of one or 
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more flow windows generated on the display screen 
122 of the display 120. The flow window is the canvas 
on which the user creates presentations. In this envir- 
onment, the user can create and edit one or more pre- 
sentations simultaneously by selecting icons, placing 
the icons in a particular location of a flow window, and 
defining the selected icons. The icons represent op- 
erations or activities to be performed during the exe- 
cution of a presentation. 

From the flow editor 210, the user can invoke the 
applications mover 220, the database editor 230, the 
evaluator 240, the object editor 250, the videodisc 
controller 260, and the expression editor 280, each of 
which will be described below. Additionally, the user 
can invoke the help system 270 from the flow editor 
210. 

In the preferred implementation menus, which are 
collections of system options, may be displayed on 
the current display screen 122 when and while the 
user presses the right mouse button 112. The user 
may then move the cursor, using the mouse 110, 
through the options of the displayed menus. As the 
cursor passes over a menu option, the option is high- 
lighted on the display screen. The user may make a 
selection of one of the menu options by releasing the 
right mouse button 1 12 while the preferred implemen- 
tation highlights the selected option. The preferred im- 
plementation supports menus in the flow editor 210 
and the object editor 250 to allow the user to move 
throughout the editors and other support systems of 
the preferred implementation, as well as to add ob- 
jects to the current display screen and select other 
editor-mode selections, e.g., alter color of current dis- 
play screen of the flow editor. 

Fig. 3 illustrates an example of a flow window 300. 
The flow window 300 is the interface used to create 
and edit presentations in the preferred implementa- 
tion of the present invention. The flow window 300 is 
comprised primarily of the Graphic Interface Display 
(or GRID) 31 0 upon which a user can place selected 
icons (discussed below). One or more icons on the 
GRID 310 can form a presentation. 

The flow window 300 also consists of a number 
of gadgets. A gadget is an area in the flow window 300 
which allows the user to change what is being dis- 
played by communicating a command to the CPU 102 
(Fig. 1 ). The flow window 300 includes a close window 
gadget 315, a drag bar gadget 320, window-to-front 
gadget 325, a window-to- back gadget 330, a vertical 
positioning gadget 335, a horizontal positioning gad- 
get 340, scrolling gadgets 345a and 345b, and 350a 
and 350b, and a flow window resizing gadget 355. 

When the user manipulates the mouse 1 1 0 so as 
to position the cursor on the close window gadget 31 5 
and clicks the left mouse button 113, the flow editor 
210 of the preferred implementation receives a com- 
mand to close the flow window 300. A click of the left 
mouse button 1 13 is a quick press and release of that 



button 113. 

The drag bar gadget 310 serves two purposes. 
First, the drag bar gadget 320 serves as an area of the 
flow window 300 in which the name or title of the pre- 

5 sentation may be displayed. When the user has not 
yet titled the presentation presently displayed on the 
GRID 310, the area of the drag bar gadget 320 in 
which the title would be displayed contains the title: 
Untitled, as illustrated in Fig. 3. A presentation name 

10 would appear in place of the untitled area of the drag 
bar gadget 320 if the user names the current presen- 
tation in the GRID 310 or loads from the disk drive 105 
a previously saved presentation (discussed below). 
Second, the drag bar gadget 320 may be used to re- 
ts position the flow window 300 horizontally or vertically 
within the display screen 122 of the display 120 (Fig. 
1 ). Again, to reposition the flow window 300, the user 
positions the cursor on the drag bar gadget 320 using 
the mouse 110 and depresses the left mouse button 

20 113. Using the mouse 110, the user can then drag or 
move the flow window 300 within the display screen 
122 until the left mouse button 1 15 is released. 

The window-to-front gadget 325 and the window- 
to-back gadget 330 serve opposite purposes. The 

25 window-to-back gadget 325 permits the user to move 
a currently displayed flow window 300 to the back of 
all currently displayed flow windows. The window-to- 
front gadget 330 permits the user to move a currently 
displayed flow window 300 to the front of all currently 

30 displayed flow windows. Again, these gadgets are ac- 
tivated by positioning the cursor on the selected gad- 
get in the display screen 1 22 using the mouse 110 and 
clicking the left mouse button 113 thereby instructing 
the flow editor 200 to reposition the currently dis- 

35 played flow window 300 in accordance with the select- 
ed gadget. 

The vertical positioning gadget 335 and horizon- 
tal positioning gadget 340 permit the user to instruct 
the flow editor 21 0 to view a viewable portion or region 
40 of the presentation presently displayed on the GRID 
310. The viewable portion of the presentation is deter- 
mined by the selected size of the flow window 300. 
The scrolling gadgets 345a and 345b, and 350a and 
350b permit the user to scroll vertically or horizontally 
45 within a presentation and the flow window resizing 
gadget 355 permits the user to resize the flow window 
300. These gadgets and all other gadgets and buttons 
on the display screen 1 22 during execution of the pre- 
ferred implementation are initiated in the same man- 
so ner as the gadgets discussed above. 

Returning to Fig. 2, the preferred implementation 
of the present invention also includes an applications 
mover 220 which is used by the preferred implemen- 
tation to move presentations from one location, e.g. 
55 the disk drive 105 (Fig. 1), to another location, for ex- 
ample a second disk drive (not shown in Fig. 1). The 
details of the applications mover 220 will be dis- 
cussed below with reference to Fig. 22. 
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The preferred implementation includes a data- 
base editor 230 which permits the user to create and 
manipulate databases for use with presentations. The 
database editor 230 allows the user to create a data- 
base in a standard database format; add, update and 5 
delete data records; as well as delete full databases. 
These operations of the database editor are conven- 
tional, however, the method by which the preferred 
implementation interfaces with the database editor 
230 is not conventional and will be described below w 
with reference to Figs. 17-20. 

The preferred implementation also includes an 
evaluator 240. The evaluator 240 of the preferred im- 
plementation of the present invention controls the 
execution of presentations created with the editors 15 
210, 250, and 280, and the videodisc controller 260. 
The details of the evaluator 240 of the preferred im- 
plementation will be described below with reference 
to Figs. 23A - 23G. 

The object editor 250 of the preferred implemen- 20 
tation is used to create display objects for use in a pre- 
sentation. Display objects are independent visual ob- 
jects which the user can place on the display screen 
1 22 (Fig. 1 ). The preferred display objects are: (1) rec- 
tangles, (2) polygons, (3) lines, (4) circles, (5) ellipses, 25 
(6) text, (7) brushes, and (8) data entry fields. With the 
object editor 250, the user can create these objects 
and turn these objects into user input areas that add 
interactivity to presentations. These input areas are 
referred to as hit boxes. The functions of the object 30 
editor 250 will be discussed below with reference to 
Figs. 16A- 16M. 

The preferred implementation also contains a vid- 
eodisc controller 260. This controller 260 is used to 
define video sequences or display selected frames of 35 
a videodisc. The videodisc controller 260 permits the 
user to view video, save frame numbers of a video- 
disc, and perform other browsing functions of a video- 
disc. The frame numbers are saved so that they may 
be used with the video icon (discussed below) to in- 40 
elude video in a presentation. 

The preferred implementation also includes an 
expression editor 280. The expression editor 280 is 
used to define variables and expressions used in a 
presentation. Variables are useful for storing values in 45 
either numerical or in alphabetical (string) form. Vari- 
ables can then be used in expressions which may be 
assignment expressions or conditional expressions. 

An assignment expression is an expression in 
which the presentation requests that the preferred im- so 
plementation assign a value to a variable, for example 
SCORE = 100. In this example of an assignment ex- 
pression, the variable SCORE is assigned the value 
1 00. In this manner, a presentation can refer to the va- 
riable SCORE for the number 1 00. The conditional ex- 55 
pression is generally used to control flow of a presen- 
tation. For example, a conditional expression may be 
SCORE >= 1 00. In this expression, SCORE is greater 



than or equal to 100 and the preferred implementation 
understands this conditional expression as meaning 
"if score is greater than or equal to 100." Further de- 
tails of the expression editor will be described below 
with reference to Figs. 13 and 14. 

Finally, the preferred implementation includes a 
help system 270. The help system 270 provides the 
user with helpful information which the user requires 
in order to properly perform selected functions within 
the preferred implementation. The functions used by 
the help system 270 of the preferred implementation 
are conventional and will therefore not be described. 

B. Icons (Menus and Submenus) and Relationships 

At the center of the preferred implementation is 
the icon menu which stretches across the bottom of 
the display screen 122 (Fig. 1) when the preferred im- 
plementation is first invoked by the user. The user in- 
puts to the CPU 102 an appropriate command to in- 
voke or begin the processing of the preferred imple- 
mentation. When the preferred implementation is in- 
voked by the user, the processing of the flow editor 
210 begins. 

To select an icon from the icon menu, the user 
positions the cursor, using the mouse 110 (Fig. 1), on 
the selected icon and clicks the left mouse button 113. 
The preferred implementation then either displays an 
icon submenu (Figs. 5A - 5F) or permits the user to 
drag the selected icon into the flow window 300 for 
placement in the GRID 310. 

Fig. 4 illustrates the main icon menu 400 of the 
preferred implementation of the present invention. 
When entering the flow editor 210 (Fig. 2), the main 
icon menu 400 appears on the bottom of the display 
screen 122. In addition to a trash can icon 410, the 
main icon menu 400 offers access to six submenus of 
icon commands. 

The trashcan icon 410 displayed in the main icon 
menu 400 is used during an editing session in the flow 
editor 210 (Fig. 2) of the preferred implementation to 
throw away or discard unwanted icons. 

The control icon 420 offers the submenu of icons 
illustrated in Fig. 5A, the interrupt icon 430 offers the 
submenu of icons illustrated in Fig. 5B, the data icon 
440 offers the submenu of icons illustrated in Fig. 5C, 
the wait icon 450 offers the submenu of icons illustrat- 
ed in Fig. 5D, the AV icon 460 offers the user a sub- 
menu of icons illustrated in Fig. 5E, and the module 
icon 470 offers the user a submenu of icons illustrated 
in Fig. 5F. 

Fig. 6 is a state diagram which illustrates the 
method used by the preferred implementation to scroll 
from the main icon menu 400 to the icon submenus 
illustrated in Figs. 5A - 5F. First, when the user begins 
an editing session in the flow editor 21 0 of the prefer- 
red implementation, the main icon menu 400 is dis- 
played in the bottom of the display screen 122 (state 
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610). When the user positions the cursor using the 
mouse 1 10 on an icon in the main icon menu 400 and 
clicks the left mouse button 1 13 on the selected icon, 
the user selects one of the icon submenus (state 620) 
and the selected icon submenu along with the main 
menu icon (not shown in Figs. 5A - 5F) and trashcan 
icon 410 are displayed on the bottom of the display 
screen 122 (state 630). 

When the user positions the cursor using the 
mouse 110 on an icon from the selected icon subme- 
nu and clicks the left mouse button 113 on the icon, 
the selected icon becomes a draggable object. Hold- 
ing the left mouse button 113 down, the user can then 
drag a copy of the icon from the icon submenu into the 
GRID 310 of the flow window 300. The icon remains 
a draggable object until the user releases the left 
mouse button 113 (used to drag the icon) when the 
icon is in the selected space on the GRID 310 (state 
640). This process is described below in detail with 
reference to the processes of the flow editor 210. 

Once the left mouse button 1 13 is released, flow 
editor operation is returned to the submenu state 630. 
To return from the submenu state 630 to the main icon 
menu state 610, the user merely positions the cursor 
using the mouse 110 on the main menu icon (not 
shown) which is displayed on the far right in every icon 
submenu and clicks the left mouse button 113. This 
informs the flow editor 210 to return to the main menu 
state 610. 

Each of the icons in the icon submenus (Figs. 5A 
- 5F) represents an action to be performed at the time 
of the presentation's evaluation (discussed below). 
Most of the icons perform a general type of action 
(e.g., playback of animation), but must be individually 
defined by the user. This definition may include, for 
example, the selection of the animation file to be 
played, the number of iterations, the position on the 
screen, as well as other pieces of information. 

The flow window 300 is displayed with the GRID 
310 marking the positions icons may be placed. An 
icon's position, relative to the other icons in the GRID 
310, determines how the icons interact The default 
traversal of the icon structure is from the top of a pre- 
sentation in the GRID 310 to the bottom. Icons imme- 
diately above/below each other are called sibling 
icons. Certain icons may be used to group a collection 
of other icons. These are displayed on the main icon 
menu 400 (Fig. 4) or submenus (Fig. 5A - 5F) with a 
hollow triangle pointing to the lower right of the icon. 
When these types of icons are placed in the GRID 
310, other icons may be placed below and to the right 
of them. The triangle is then displayed as a solid, with 
the marked icon being called the parent and the lower 
icons called children. 

This parenting process allows a presentation to 
be maintained in a modular manner. When a parent 
icon is dragged about the presentation and placed in 
a new position, all of its children are also moved to the 



new location. When the parent is dragged outside of 
the GRID 310 and dropped on top of the trashcan icon 
410, all of its children are also deleted from the dis- 
played presentation. 

5 In the preferred implementation, there are four 

basic icon relations: parent icons, child icons, sibling 
icons, and partner icons. These relations can have a 
direct effect on the order of execution of a presenta- 
tion which will be discussed below. 

10 In the preferred implementation, there are nine 

icons which can function as parent icons: the module 
icon 551, subroutine icon 552, screen icon 541, loop 
icon 504, form icon 526, select icon 521, keyboard in- 
terrupt icon 51 1, mouse interrupt icon 512, and group- 

15 ed wait icon 531 , each of which will be described be- 
low with reference to Figs. 5A - 5F. As stated, these 
parent icons are identified by the presence of a hollow 
triangle in the lower right of the icon. This triangle in- 
dicates that the user can place chfld icons underneath 

20 the parent icon. When a parent icon is selected and 
placed in the GRID 310 and the user selects one or 
more child icons and places them to the right of the 
parent icon, the triangle is filled in. On the GRID 31 0, 
child icons would be placed beginning one column to 

25 the right and one row down from a parent icon. 

Fig. 7A illustrates an example of the parent icon- 
child icon relationship. The module icon 705 of Fig. 7A 
is a parent icon. This is identified by the triangle in the 
lower right comer of the module icon 705. In this case, 

30 the triangle of the module icon 705 is filled in or ap- 
pears solid because this module icon 705 has child 
icons: the screen icon 710, and the brush icon 730. 
The graphic icon 720 is a grandchild to the module 
icon 705 and is therefore a descendant of the module 

35 icon 705. The operations or acts which would be per- 
formed in response to each of these icons will be de- 
scribed below with reference to Figs. 5A - 5F. The 
screen icon 710 of Fig. 7A is a parent icon with the 
graphics icon 720 as its child. The parent-child rela- 

40 tionship of icons in the preferred implementation is im- 
portant because the relationship of icons determines 
the method and order by which the evaluator 240 will 
execute the operations or acts identified by the icons. 
Fig. 7B also illustrates another example of the 

45 parent icon- child icon relationship, however, in Fig. 
7B, the loop icon 735 is a parent icon which signifies 
that this parent icon-child icon relationship is one of a 
parent iterative relationship. This means that the loop 
icon 735 is used to inform the evaluator 240 to repeat 

so certain operations identified by the child icons of the 
loop icon 735. The actions of the child icons would be 
repeated until a condition associated with the loop 
icon 735 is evaluated as true. In this example, the 
brush icon 740 and the wait mouse icon 745 would be 

55 child icons of the parent loop icon 735 and these child 
icons may be performed more than once, depending 
upon the conditions of the loop icon 735. 

The preferred implementation also has sibling 
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icons. Sibling icons are icons that are directly above 
and below each other. The sibling icon may have a 
partner icon or one or more child icons. Fig. 7C illus- 
trates an example of three sibling icons: an animation 
icon 750, a speech icon 755, and a wait mouse icon 5 
760, each of which will be described below with refer- 
ence to Figs. 5A - 5F. As sibling icons, when the eval- 
uator 240 of the preferred implementation executes 
the operations of the these icons, their operations are 
performed in a top-down fashion or sequentially. 10 

The forth icon relation used by the preferred im- 
plementation is the partner relationship. Fig. 7D illus- 
trates an example of the partner icon relationship. The 
rf-then-eJse icon 765 requires a partner icon which, in 
this example, is the brush icon identified by the label is 
brush 1 770. If the expression or condition associated 
with trie rf-then-eise icon 765 is evaluated during exe- 
cution as true, then the operations of the partner icon, 
the brush 1 icon 770, will be executed. Otherwise if the 
condition of the if-then-else icon 765 is evaluated as 20 
false, then the operation of the sibling icon, the brush 
icon labeled brush 2 775 is executed. In the preferred 
tmplementaton. tf the operation of the partner icon of 
an if-then-elsc con 765 is executed, then the evalua- 
te* 240 will continue execution beginning with the next 25 
sibling icon *nmediately following the icon which fol- 
lows the if-then-else icon. In this example, if the ac- 
tions of brush 1 770 are executed, then brush 2 775 
is skipped and evaluation continues with the icon fol- 
lowing brush 2 775 in the presentation which is the 30 
wait mouse con 780. 

Returning to Figs. 4 and 5A - 5F, the main icon 
menu 400 and con submenus Figs. 5A-5F will be de- 
scribed. When the user selects an icon from the sub- 
menus Figs. SA - 5F and places the selected icon in 35 
the GRID 310 for a presentation, an icon requester 
must, m most cases, be completed to define the se- 
lected icon. Several icons however do not require def- 
inition using requesters or the expression editor 280. 

E acn con in the submenus Figs. 5A - 5F has a dif- 40 
ferent icon requester. In general, an icon requester is 
a window (or framed area on the display screen 122) 
containing ^formation specific to a given icon which 
must be completed by the user to properly define or 
describe the attributes for an icon. As will be descri- 45 
bed in detal below with reference to the operations of 
the flow editor 210. after the user selects an icon and 
places it in the GRID 310, the user clicks the left 
mouse button 113 twice (a double click) to reveal (or 
to have the flow editor 210 generate on the display 50 
screen 122) the appropriate icon requester. The user 
then completes the icon requester to properly define 
the icon for later evaluation by the evaluator 240 of the 
preferred implementation. In cases where no icon re- 
quester is used to define an icon the expression editor 55 
280 may be used to define the icon. In other cases, 
no icon definition is necessary, e.g. call icon or goto 
icon. 



The submenu accessible through the control icon 
420 of the main icon menu 400 is used to affect the 
flow of a presentation through the use of branches 
and conditional statements. When the user is in the 
flow editor 210 of the preferred implementation and 
selects the control icon 420, the main icon menu 400 
displayed on the bottom of the display screen 122 is 
replaced by the control icon submenu 500 (Fig. 5A). 
In addition to the submenu 500, the trashcan icon 410 
is displayed in the far left of the bottom of the display 
screen 122 and the main menu icon (not shown) 
which, when selected by the user, returns the main 
icon menu 400 to the display screen 122, is displayed 
in the far right of the bottom of the display screen 1 22. 
Both the trashcan icon 410 and the main menu icon 
(not shown) are displayed when the preferred imple- 
mentation is in the submenu state 630 (Fig. 6) with 
any of the submenus (Figs. 5A - 5F) displayed on the 
display screen 122. 

The control icon submenu 500 consists of 7 icons. 
The call icon 501 executes a subroutine which must 
be defined by the user using the subroutine icon 552 
of Fig. 5F. When the user is in the flow editor 21 0 and 
selects the call icon 501 and places a copy of the call 
icon 501 in the GRID 310 (Fig. 3), a referencing pla- 
ceholder icon (not shown) will appear on the GRID 
310 adjacent to the selected call icon which is used 
to hold the partner icon for the call icon. The partner 
icon for the call icon 501 is the subroutine icon 552 of 
Fig. 5F. 

A subroutine is a collection of icons with the sub- 
routine icon 552 of the module icon submenu 550 of 
Fig. 5F as its parent. During evaluation, when a pre- 
sentation reaches a call icon 501 , the referenced sub- 
routine identified in the partner icon to the call icon is 
performed. During the performance of the subroutine, 
when either a return icon 554 (Fig. 5F) is encountered 
or if the subroutine is completed, the presentation will 
continue starting with the icon following the call. 

To select a partner to the call icon 501 placed in 
the GRID 310, the user double clicks the left mouse 
button 113 on the referencing placeholder icon adja- 
cent to the referencing icon (e.g., call icon 501). The 
user is then asked whether he or she wishes to specify 
the icon to be referenced (e.g., the partner). If yes, 
then the next icon upon which the user places the cur- 
sor on the display screen 122, using the mouse 110, 
and double clicks the left mouse button 113 initiates 
the referencing process. The user if then asked if the 
double clicked icon is the desired referencing partner 
icon. If yes, then the referenced icon's image replaces 
the original referencing placeholder icon, and the ref- 
erencing process is complete. If the user does not 
wish to reference the selected icon, then the selection 
process may be continued with another reference 
icon or aborted. 

The conditional-goto icon 502 is used to branch 
to another part of a presentation on a specified con- 
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dition. This icon conditionally transfers the flow of log- 
ic from one part of the presentation to another. The 
conditional-goto icon 502 cannot contain children, but 
requires a partner. The partner is a reference to an 
icon elsewhere in the presentation. In a manner sim- 5 
ilar to the call icon 501 , when the user selects the con- 
ditional-goto icon 502 and places the icon on the 
GRID 310 for a presentation, a placeholder icon (not 
shown) appears in the GRID 310 adjacent to the con- 
ditional-goto icon which holds the place for the partner 10 
icon which will identify where to branch to in the pre- 
sentation. The user selects a partner for this icon in 
the manner described above with reference to the call 
icon 501. Additionally, the user must input an expres- 
sion, using the expression editor 280 (discussed be- 15 
low), to indicate to the presentation when it is to 
branch to the identified partner. To invoke the expres- 
sion editor 280, after placing the conditional- goto icon 
502 on a GRID 310, the user places the cursor over 
the icon and double clicks the left mouse button 1 13. 20 

Another control icon in the control icon submenu 
is the goto icon 500. This icon is used for uncondition- 
al branching or transfer control within a presentation. 
The goto icon 503 cannot contain children, but, like 
the call icon and conditional goto icon 502, requires a 25 
partner. Again, when the goto icon 503 is selected by 
the user from the control icon submenu 500 and 
placed in a GRID 310, a placeholder appears in the 
GRID adjacent to the goto icon and the user must 
specify where the presentation is to branch to when 30 
executing the goto statement. This icon represents an 
unconditional branch in a presentation and therefore 
does not require definition by using a requester or the 
expression editor 280. However, the user must select 
a partner for this icon in the manner described above 35 
with reference to the call icon 501. 

Another control icon in the control icon submenu 
500 is the loop icon 504. The loop icon 504 is used to 
specify a loop structure within a presentation. The 
loop icon 504 does not have a partner, but it does re- 40 
quire children as described above with reference to 
Fig. 7B. Children are identified on the GRID 310 by 
placing icons on the GRID 310 in the column to the 
right of the parent icon beginning with the row directly 
below the row upon which the parent icon is placed. 45 
The user selects the loop icon 504 to set up a structure 
to cycle through a group of children icons. 

Three types of loops may be constructed with the 
flow editor 210 and are defined using the loop icon re- 
quester and the expression editor (discussed below). so 
They are: the endless loop, the counted loop, and the 
conditional loop. Each of these loop structures has dif- 
ferent exit conditions. The endless loop can be termin- 
ated with the loop exit icon 505, which can also be 
used to terminate the other types of loop structures. 55 
The counted loop terminates at the end of the count 
specified using the loop icon requester and the con- 
ditional loop is ended when a selected condition, writ- 



ten in the expression editor, is set to false during the 
performance of a presentation. During a presentation, 
when the presentation reaches a loop icon, the ac- 
tions of the children icons are performed. When the 
actions of the children icons are completed, the pre- 
sentation will resume execution from the beginning of 
the loop. If an exit condition is reached, the loop stops 
and the presentation moves on to the next sibling of 
the loop icon. 

The exit loop icon 505 ends a loop structure and 
during a presentation, when an exit loop icon 505 is 
reached, the presentation continues with the next sib- 
ling icon following the loop. The loop exit icon cannot 
contain children and does not have a partner icon. 
The loop exit icon 505 does not require definition by 
an icon requester because when this icon is encoun- 
tered during execution of a presentation, the current 
(inner-most) loop executing is exited. 

The if-then icon 506 of the conditional icon sub- 
menu 500 is used to define a condition which, if true, 
will cause the action of its partner icon to be per- 
formed during a presentation. If the condition is false 
the partner icon is skipped and the action of the sibling 
icon following the if-then icon will be performed. In 
either case, the icon following the if-then icon is al- 
ways performed. Thus, the if-then icon 506 cannot 
have children but does require a partner. Again, to set 
the condition for the if-then icon, the user defines the 
if-then icon 506 using the expression editor (dis- 
cussed below) which can be initiated from the flow 
editor 210 by double clicking the left mouse button 
113 while the cursor is positioned on the if-then icon 

506 placed in the GRID 310. The partner icon for the 
if-then icon 506 is selected in the same manner dis- 
cussed above with reference to the call icon 501 . 

Finally, the control icon submenu 504 has an if- 
then-else icon 507. This icon 507 defines a condition 
for executing one of two separate icons: one if the 
case specified in the condition, set using the expres- 
sion editor, is true and one if the condition is false. 
Similar to the if-then icon 506, the if-then-else icon 

507 cannot have children, but requires a partner. Dur- 
ing the presentation, if the condition specified for the 
if-then-else icon in a presentation is true, the presen- 
tation performs the actions of its partner icon. It then 
skips the icon following the rf-then-else icon which 
represents the else part. If the condition is false, then 
the presentation performs the action of the else part, 
which is the sibling icon immediately following the if- 
then-else icon. The if-then-else icon 507 in a presen- 
tation is defined using the expression editor (dis- 
cussed below). 

Returning to Fig. 4, the icon main menu 400 also 
has an interrupt icon 430. When the interrupt icon 430 
is selected by the user in the flow editor 210, the in- 
terrupt icon submenu 510 of Fig. 56 is displayed on 
the bottom of the display screen in place of the main 
icon menu 400. The interrupt icon submenu 510 in the 
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preferred implementation consists of three interrupt 
icons: (1) the keyboard interrupt icon 511, (2) the 
mouse interrupt icon 512, and (3) the remove interrupt 
icon 51 3. These icons are used to define an action in 
a presentation that is to be performed during a presen- 
tation when the executing presentation is interrupted. 

The keyboard interrupt icon 51 1 allows an inter- 
ruption to the executing presentation when certain 
keys are pressed. If one of the specified keys is press- 
ed, the presentation will pause, and the actions of the 
children of the keyboard interrupt icon will be per- 
formed. Thus, the keyboard interrupt icon 51 1 can 
have chldren as well as siblings. The keyboard inter- 
rupt icon 511 is defined using the keyboard interrupt 
icon requester and the object editor 250 (discussed 
below). To initiate the keyboard interrupt requester, 
the user double clicks the left mouse button 113 while 
the cursor is on the icon in the GRID 310. The key- 
board interrupt requester has a gadget that, when se- 
lected, enables the user to enter the object editor 250. 

The mouse interrupt icon 512 interrupts a presen- 
tation when a mouse button 1 12 or 113 is clicked. The 
mouse interrupt icon 512 defines an interrupt to the 
presentation flow if the mouse is clicked in a certain 
area of the display screen 122. If interrupted, the pre- 
sentation will pause and the actions of children of the 
interrupt win be performed. The mouse interrupt icon 
512 » defined using the mouse interrupt icon request- 
er end the object editor 250 (discussed below). To ini- 
tiate the mouse interrupt requester, the user double 
clicks the left mouse button 1 13 while the cursor is on 
the icon in the GRID 310. The mouse interrupt re- 
quester has a gadget that, when selected, enables the 
user to enter the object editor 250. 

Finally, the remove interrupt icon 513 only dis- 
ables interrupts in the same column on the GRID 310 
of the presentation that have the same parent. This 
icon 513 does not contain children. 

Another submenu of the main icon menu 400 is 
the data icon submenu 520 illustrated in Fig. 5C. The 
data icon submenu 520 defines a set of icons used to 
define variables, define data entry forms, store and re- 
trieve data from a database, and define printed or file 
output in a presentation. Of the data icons in the data 
icon submenu 520 there are three icons which exclu- 
sively relate to data operations on an existing data- 
base: the select icon 521 , the read/write icon 522, and 
the delete icon 523 (Fig. 5C). 

The select icon 521 of the submenu 520 can be 
used to open a database file and select records using 
one or more fields. The select icon can have other 
icons as children. One or more of the fields may be 
key fields. As described more fully below with refer- 
ence to the database editor 230 of the preferred im- 
plementation, a key is made up of one or more fields 
of the database record structure and is used when 
searching the data file for a specific record or a set of 
records. For example, a database of employee infor- 



mation may contain employee information alphabeti- 
cally by the last name or by employee ID number. 
Therefore when creating the database the last name 
field and employee ID field are specified as key fields. 
5 In this way, the user can access data records either 
by specifying the employee ID or the employee last 
name. The select icon 521 in a presentation is defined 
using the select icon requester. 

Another data icon in the data icon submenu 520 
10 is the read/write icon 522. This icon 522 reads and 
writes to database records which were previously se- 
lected using the select icon 521 . The read/write icon 
522 cannot contain children. When using this icon, the 
user assigns a variable to a field in the database re- 
ts cord, and selects the appropriate action (read, insert, 
or update). The read/write icon 522 in a presentation 
is defined using the read/write icon requester. 

Another data icon in the data icon submenu 520 
is the delete icon 523. This icon 523 removes the cur- 
20 rentiy selected record. This icon 523 has no children 
and is defined using the delete icon requester. 

The next icon in the data icon submenu is the va- 
riables icon 524. This icon 524 is used to define new 
global variables, or assign new values to existing va- 
25 riables by evaluating expressions specified by the 
user. The difference between global variables and lo- 
cal variable is conventional. Global variables can be 
accessed from anywhere in a presentation and local 
variables can only be accesses in a particular region 
30 of a presentation, e.g., within a subroutine. The vari- 
ables icon 524 can have no children and is defined us- 
ing the variables icon requester and the expression 
editor 280. 

Next in the data icon submenu 520 is the output 
35 icon 525. The output icon 525 is used to send a single 
line of output to a disk file or a printer. The output icon 
525 cannot contain children and is defined using the 
output icon requester. 

The data form icon 526 follows to the right of the 
40 output icon 525 on the data icon submenu 520. This 
icon 526 defines forms on-the screen for data entry by 
users during the execution of a presentation. The data 
form icon 526 can have other icons as children. The 
object editor 250 (discussed below) is used to define 
45 all of the data fields for the form. 

Finally, the data form exit icon 527 of the data icon 
submenu 520 is used to exit or abort a data form op- 
eration. The form exit icon 527 cannot contain chil- 
dren and this icon 527 can only be used as a chid to 
so the data form icon 526. 

Returning to Fig. 4, to the right of the data icon 
440 is the wait icon 450. When the user selects the 
wait icon 450, the wait icon submenu 530 illustrated 
in Fig. 5D replaces the main icon menu 400 on the bot- 
55 torn of the display screen 122. The wait icon submenu 
530 consists of five icons. 

The first icon in the wait icon submenu 530 is the 
grouped wait icon 531. This icon 531 is used to com- 
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bine wait icons. The function of the grouped wait icon 
531 is as a parent to other specific wait icons from the 
wait icon submenu 530. This icon 531 waits for any 
one or all of its children to be completed. 

The next icon on the wait icon submenu 530 is the 
wait condition icon 532. This icon 532 is used to wait 
for a specific condition to be true. Once the condition 
occurs, the presentation continues. This icon 532 
cannot contain children and the condition is defined 
using the wait condition icon requester and the ex- 
pression editor 250 (described below). 

The next icon in the wait icon submenu 530 is the 
wait keyboard icon 533 which is used to pause the 
presentation and wait for a desired keystroke. This 
icon 533 cannot contain children. When the user se- 
lects this icon 533, there are two options. The first is 
to wait for a specific key or keys to be pressed. Sec- 
ond, the user may allow for the presentation to wait for 
any key to be pressed. A keyboard icon requester and 
the object editor 250 are used define the condition of 
this wait icon 533. The display objects and text for the 
wait keyboard icon 533 are created in the object editor 
250 (described below). 

The next wait icon in the wait icon submenu 530 
is the wait mouse icon 534. This icon 534 is used to 
pause a presentation and wait for a desired dick of a 
mouse button 1 1 2 or 1 1 3 (Fig. 1 ). The wait mouse icon 
534 has no children. Similar to the wait keyboard icon 
533, the wait mouse icon 534 has two options. First, 
is to wait for a mouse click in a specific hit box or area 
of the display screen 122 and the second is to wait for 
any mouse click. A wait mouse icon requester and the 
object editor 250 are used define the condition of this 
wait icon 534. The display objects and text for the wait 
mouse icon 534 are created in the object editor 250 
(described below). 

Finally, the last icon in the wait icon submenu 530 
is the delay icon 535. The delay icon 535 is used to 
pause the presentation for a specified number of sec- 
onds. It does not require a response from the user. 
This icon 535 has no children. With this icon, during 
evaluation (or execution of a presentation), the eval- 
uated 240 does not move to the next icon until a preset 
time has elapsed. The delay icon 535 is defined by the 
delay icon requester. 

Referring again to Fig. 4, the main icon menu 400 
also contains an AV icon 460. When this icon is se- 
lected, the AV icon submenu 540 illustrated in Fig. 5E 
replaces the main icon menu 400 on the bottom of the 
display screen 122 (Fig. 1). Audiovisual icons are 
used to perform operations such as playing video, ani- 
mation, sound, speech, or musical files, and display- 
ing pictures and graphics. 

The left-most icon in the AV icon submenu 540 is 
the screen icon 541. The screen icon 541 is used to 
define the background screen for presenting any vis- 
ual information such as pictures. This icon 541 uses 
an icon requester to specify display parameters, e.g., 



screen resolution, number of colors, palette, and the 
size of the picture. The screen icon 541 may also be 
used to load a bit-mapped image from the disk drive 
105 (Fig. 1) to display on the display screen 122. Bit- 
s mapped images are conventional and therefore will 
not be explained. The screen icon 541 can have other 
screen icons as children as well as any other AV icons 
from the AV icon submenu 540. 

To the right of the screen icon 541 on the AV icon 

10 submenu 540 is the digitized sound icon 542. This 
icon 542 is used to play a recorded voice or sound that 
has been previously digitized. This icon 542 cannot 
have children and is defined using the digitized sound 
icon requester. 

15 Next in the AV icon submenu 540 is the synthe- 

sized speech icon 543. The synthesized speech icon 
543 can be used to play back text that the user inputs 
or text from an ASCII text file. This icon 543 cannot 
contain children and is defined using the synthesized 

20 speech icon requester. 

Next to the synthesized speech icon 543 on the 
AV icon submenu 540 is the music icon 544. The mu- 
sic icon 544 is used to play back musical scores cre- 
ated in music software programs. This icon 544 also 

25 cannot contain children and is defined using the music 
icon requester. 

The fourth icon from the left in the AV icon sub- 
menu 540 is the graphics icon 545. This icon is used 
to modify and control the display screen 122 (Fig. 1) 

30 and enables the user to place display objects (created 
using the object editor) on the display screen 122. 
This icon also lets the user specify color cycling ef- 
fects. Like most of the AV icons, this icon 545 also 
cannot have children and is defined using a graphics 

35 icon requester. 

To the right of the graphics icon 545 in the AV icon 
submenu 540 is the brush icon 546. This icon 546 is 
used to overlay a specific picture file on top of the cur- 
rent display screen 122. The brush icon 546 also can- 

40 not have children. The brush icon 546 differs from the 
screen icon 561 in that it does not delete the existing 
background pictures or graphics on the display 
screen 122. It also does not modify screen attributes 
such as resolution. However, the user may specify pa- 

45 lette changes in the brush icon requester used to de- 
fine this icon 546. 

The AV icon submenu 540 also contains a video 
icon 547. The video icon 547 is used to play a seg- 
ment of video or a single video frame from a videodisc 

so player which may be part of the platform 1 00 of Fig. 
1 . The video icon 547 cannot have children and is de- 
fined using the video icon requester and may make 
use of the videodisc controller 260 (discussed below). 
To the right of the video icon 547 on the AV icon 

55 submenu 540 is the animation icon 548. The anima- 
tion icon 548 is used to play back an animation file 
which has been created in a conventional paint or ani- 
mation software application. The animation icon can- 
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not have children and is defined by the animation icon 
requester. 

At the right hand side of the AV icon submenu 540 
is the text file icon 549. The text file icon 549 is used 
to display text from an ASCII file onto the display 
screen. The text file icon cannot have children and is 
defined using the text file icon requester. 

Returning to Fig. 4, the last icon on the right of the 
icon main menu 400 is the module icon 470. When the 
user selects the module icon 470, the main icon menu 
400 is replaced on the display screen 1 22 (Fig. 1 ) with 
the module icon submenu 550 illustrated in Fig. 5F. 

The module icon submenu 550 consists of six 
icons. The first icon in the module icon submenu 550 
is the module icon 551. The module icon 551 is used 
to help organize presentations. The module icon 551 
can be used as a parent for other icons or groups of 
icons including other module icons. Thus the module 
icon 551 can contain other module icons like itself, as 
well as other icons as its children. The module icon 
541 can also be a child to other parent icons. The 
module icon is defined using the module icon request- 
er and the expression editor 280. Variables defined in 
a module of a presentation are local to that module. 
For example, if the user defines variables for the mod- 
ule icon 705 in Fig. 7 A, these variables exist during 
the evaluation of the module icon's 705 descendants 
including icons 710, 720 and 730. These local vari- 
ables would not exist during the evaluation of the 
module icon's 705 siblings (not shown). 

Another icon in the module icon submenu 550 is 
the subroutine icon 552. The subroutine icon 552 pro- 
vides another method of structuring a set of actions 
that the user wisches to use repeatedly in a presen- 
tation. The subroutine icon 552 can contain other 
icons as children, but cannot contain itself as a child. 
It must always appear in the left-most column of the 
GRID and therefore, may be a sibling of the very first 
module icon. The subroutine icon 552 is defined using 
the subroutine requester and the expression editor 
280. Variables associated with a subroutine icon are 
subject to the same scoping (local) as described 
above with reference to the module icon 541. 

To the right of the subroutine icon 552 on the 
module icon submenu 550 is the quit icon 553. The 
quit icon 553 can be used to exit and return to the flow 
editor 210 when creating a presentation or terminate 
the execution of a presentation. 

The next icon in the module icon submenu 550 is 
the return icon 554. The return icon 554 explicitly 
stops the execution of a subroutine and returns con- 
trol back to the next icon following a call icon 501 . This 
icon 554 cannot have children and it can only appear 
as a part of the flow of a subroutine. The preferred flow 
editor 210 will not permit the user to place the return 
icon 554 outside of a subroutine. 

The execute icon 555 is adjacent to the return 
icon 534 in the module icon submenu 550. The exe- 



cute icon 555 references an external program and al- 
lows the external program to execute as a part of the 
presentation flow. The execute icon 555 cannot have 
children and is defined in a presentation with the exe- 

5 cute icon requester. 

The timer icon 556 of the module icon submenu 
550 is used to time specific parts of a presentation. It 
does not stop the presentation, but merely acts as a 
stopwatch measuring time in elapsed seconds with up 

w to two decimal places. This icon 556 also cannot con- 
tain children and is defined using the timer icon re- 
quester. 

Finally, the last icon in the module icon submenu 
550 is the resource control icon 557. The resource 

15 control icon 557 is used to preload and unload re- 
sources such as picture, sound, animation and music 
into memory 1 35 of the platform 1 00 (Fig. 1). This icon 
557 is used to reduce long waits in the middle of a pre- 
sentation for the system to load the required informa- 

20 tion. This icon 557 also cannot contain children and 
is defined using the resource icon requester. 

Returning to Fig. 6 the operational flow of the icon 
menus may be further explained in the context of a 
typical editing session as follows. When the flow edi- 

25 tor 210 of the preferred implementation is started, the 
user is presented with an editing screen on the display 
screen 122 showing a screen header across the top, 
a panel of icons across the bottom, and an untitled 
presentation or flow window on the left. 

30 The editing process is started by selecting a spe- 

cific icon for placement in the empty flow window 300. 
The icons initially displayed on the panel at the bottom 
of the display screen 122 consists of the main icon 
menu 400 (see Fig. 4) which represents the different 

35 types of actions the preferred implementation sup- 
ports. Positioning the cursor on an icon and clicking 
the mouse (or selecting the icon) instructs the prefer- 
red implementation to display on the bottom panel of 
the display screen 122 the appropriate icon submenu 

40 (Figs. 5A - 5F) depending upon which icon from the 
main icon menu 400 (Fig. 4) was selected. For exam- 
ple, the main icon menu 400 in the preferred imple- 
mentation has an AV icon 460 which represents the 
submenu containing all of the audiovisual actions 

45 supported by the preferred implementation. These in- 
clude the icons discussed above with reference to Fig. 
5E. 

Once the desired submenu has been displayed, 
any one of the icons in the selected submenu may 

so then be selected for placement in the GRID 310 of the 
flow window 300 by (1) positioning the cursor on the 
icon, (2) pressing the left mouse button 113, (3) hold- 
ing the left mouse button down and dragging the icon 
with this button depressed, (4) positioning the select- 

55 ed icon being held or dragged by the mouse in the 
proper position in the GRID 310 of the flow window 
300, and (5) releasing the left mouse button 1 1 3. The 
selected icon will now be added to the presentation 

13 



SDOCID: <EP 0513553A2_I_> 



25 



EP0 513 553 A2 



26 



displayed in the GRID 310. 

The definition of icons may, be performed in a re- 
quester specific to each type of icon. The requester for 
an icon placed in the GRID 31 0 is "opened 0 by double- 
clicking the left mouse button 113 (Fig. 1 ). The icon re- 
quester is then displayed on the display screen 122. 
Opening the requester for the first time presents an 
empty requester with only limited preset attributes (or 
descriptive information). The requester includes a set 
of one or more buttons which are regions that the user 
may activate to modify different attributes. The user 
can then modify any of the attributes by clicking on the 
appropriate buttons. Some buttons present further re- 
questers for entering numeric values, selecting a file 
from a directory on a disk, etc. 

Although each icon has specific attributes and 
therefore a specific toon requester, an example of an 
icon requester will now be explained with reference to 
the icon requester for the animation icon 548 dis- 
cussed above with reference to Fig. 5E. 

Fig. 8 iDustrates the preferred icon requester 800 
for the animation icon 548. The animation icon 548 is 
used to play back an animation file created using a 
conventional paint or animation software application. 
The animation icon requester 800 consists of several 
input fields in which the user must input information to 
set the attributes of the animation icon 548 or to define 
the animation icon 548. The animation icon requester 
800 also consists of several gadgets which are used 
to set icon attributes and reposition the requester 800 
on the display screen 122. To initiate each of these 
gadgets, the user positions the cursor using the 
mouse 110 on the gadget in the display screen 122 
and then clicks the left mouse button 113. This per- 
mits the user to alter the attributes associated with an 
•con using the gadgets of the icon requester. 

The first gadget in the animation icon requester 
800 is the directory gadget 81 0 which permits the user 
to select, using the file requester, the name of an ani- 
mation file to be played. Alternatively, the user may 
dick the left mouse button 113 on the filename field 
815 in the animation icon requester 800 and type in 
the name of an animation file in the space 815. The 
animation icon requester 800 also has an override 
screen gadget 820 which defaults to "on" and uses the 
screen resolution of the animation file, completely re- 
placing the previous screen. If the user clicks the left 
mouse button on this gadget 820 to turn it off, then the 
e valuator 240, during execution of the presentation, 
will assume the current resolution, i.e., the resolution 
of the last screen that was displayed. 

The palette gadget 825 is used to specify be- 
tween the current palette and an override palette. A 
palette is the set of colors specified for display on the 
display screen 1 22. The palette gadget 825 is default- 
ed to the current palette which, if retained by the user, 
causes the specified animation to be displayed using 
the current palette of display colors. If the override is 



selected by the user, then the animation's palette will 
be used/changing the existing colors displayed on the 
display screen 122. 

The loop gadget 830 is selected if the user wishes 

5 to play the animation a specified number of times. The 
number of loop repetitions is specified in the reps field 
835a of the animation icon requester 800 by clicking 
the left mouse button 113 on the reps gadget 835 
which enables the user to enter a number into the reps 

10 field 835a. In Fig. 8, the loop gadget 830 has not been 
activated and therefore the reps gadget 835 is "ghost- 
ed" or appears shaded. If the user selects the loop 
gadget 830, then the reps gadget 835 will be "un- 
ghosted" and the user will be permitted to alter the 

15 number, e.g., 0, in the reps field 835a. 

The left gadget 845 and the top gadget 850 of the 
animation icon requester 800 are used to specify the 
coordinates of the top left corner of the picture in the 
selected animation file. The user merely clicks the left 

20 mouse button 1 13 on either gadget to enter the spe- 
cific value for these fields 845a and 850a, respective- 
ly. The transitions gadget 860 of the animation icon re- 
quester 800 is used to specify the screen pattern to 
be used when switching to the first picture of an ani- 

25 mation. 

The animation icon requester 800 also has a pre- 
view gadget 865, help gadget 870, reset gadget 875, 
and a cancel gadget 880. The preview gadget 865 is 
used to see an operation, without running the presen- 

30 tation, while you are creating the presentation. The 
help gadget 870 initiates the help system 270 of the 
preferred implementation which provides the user 
with help information concerning, in this case, the ani- 
mation icon requester 800. The reset gadget 875 

35 clears all of the attributes previously set by the user 
in the animation icon requester 800, and the cancel 
gadget 880 cancels the animation icon requester 800 
and returns the user to the point at which she selected 
the animation icon and double-clicked on the icon to 

40 initiate the animation icon requester 800 in the flow 
editor 210. 

The Icon Name field 885 allows the user to give 
a meaningful name to the icon which will be shown on 
the GRID 310. It is also useful when searching for a 

45 particular icon. The use and contents of this field is 
completely up to the user. To enter an Icon Name into 
the icon name field 885, the user merely clicks the left 
mouse button 113 on the Icon Name field 885. 

The Memo gadget 890 allows the user to add a 

so description of the actions of the icon which will be pre- 
sented only inside the requester. The use and con- 
tents of this field is completely up to the user. To enter 
a memo into the memo field 890, the user merely 
clicks the left mouse button 113 on the memo field 

55 890. 

The Pause gadget 892 allows the user to specify 
if icons following the animation icon may be started 
before the animation is completed. If the Pause gad- 
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get 892 is selected (remains checked), the animation 
will be completely presented before its sibling icon is 
started. If the Pause gadget is not selected (cleared), 
the animation will be started, and while being present- 
ed, the actions of its sibling icon will be performed. 
Other gadgets in the animation icon requester, e.g., 
the drag bar gadget 320, have already been described 
with reference to the flow window 300 of Fig. 3. 

After all attributes have been properly set, the re- 
quester can be closed, and the information saved, by 
clicking on the "OK" button 895 which is in all request- 
ers. Subsequent openings of the requester will dis- 
play the previously set attributes for review or editing. 

C. The Presentation Structure 

The preferred implementation may be used to 
generate or create a presentation, to manipulate or 
edit already created presentations and to execute pre- 
sentations using the above-described icons. How- 
ever, each icon is merely an identification of an act to 
be performed during the evaluation of the presenta- 
tion and the icon requester is used to define the iden- 
tified act. As described above, in the preferred imple- 
mentation icons have familial relationships which are 
used to determine the order in which the operations 
of a set of icons in a presentation are to be evaluated. 
This familial relationship corresponds to the underly- 
ing structure of a presentation which is evaluated by 
the evaluator 240. Fig. 9A illustrates an example of 
the structure of a presentation which will determine 
not only how the evaluator 240 would evaluate and 
execute this presentation structure but would also de- 
termine how the flow editor 210 traverses the presen- 
tation structure in response to user commands. 

A presentation structure created with the prefer- 
red implementation is made up of a RootEvent (not 
shown) and any number events and commands. The 
RootEvent is a part of every presentation structure 
and will be described below with reference to the eval- 
uator 240 processes. An event is an icon which may 
contain children and a command is an icon that may 
not contain children. 

The small block 900 on Fig. 9A shows a sample 
presentation as viewed in the flow editor. It contains 
two module icons 901 and 903 (both containing chil- 
dren) and four other icons. The module icons 901 and 
903, and all other icons which are displayed with the 
triangles, may contain zero, one, or more children, as 
described earlier. These icons are represented inter- 
nally by event structures. All icons which cannot con- 
tain children are defined internally by command struc- 
tures. 

Command and event structures are similar, with 
event structures being a superset of the command 
structures. While the complete details of these struc- 
tures need not be described here, the primary mem- 
bers are the parent list, the child list, the reference list, 



and the specific data pointer. List structures are de- 
fined by the conventional operating system, and are 
used because of the operating system-supplied rou- 
tines for fast and easy maintenance of the list con- 

5 tents. Both events and commands contain a parent 
list and specific data members, but only the event 
structure contains child list and reference list mem- 
bers. This is illustrated in Fig. 9A. For example, the 
event structure 901 contains a parent list 950, a child 

10 list 951 , a reference list 952, and a specific data mem- 
ber 953, and the command structure 902 contains a 
parent list 955 and a specific data member 956. 

The data structures that connect the event struc- 
tures and command structures of a presentation to- 
ts gether are called "LinkNodes." LinkNodes are small 
sections of memory that comprise the elements of any 
of these lists. For example, LinkNode 911 connects 
event node 901 with command node 902. The child 
list 951 of event structure 901 points to the LinkNode 

20 911 and the LinkNode 911 points to the command 
structure 902 with a pointer field 960. 

An expanded version of a LinkNode also exists 
which is called a CondNode. Co nd Nodes are used 
when two icons are displayed on the same horizontal 

25 line in the flow editor, and may only be present on an 
event structure's child list. For example, in Fig. 9A, the 
CondNode 919 refers to the conditional-goto specifier 
displayed in the small box 900. Like other LinkNodes, 
the CondNode 919 contains a pointer field that points 

30 to the command structure 905 representing the con- 
ditional-goto icon. Since the CondNode 919 is one 
which refers to another command or event in the pre- 
sentation structure 910 to be executed when a condi- 
tion is evaluated as true, the CondNode 919 contains 

35 a reference pointer field 970 which points to the ref- 
erenced command structure 902. 

All of these structures can be seen in the example 
of a presentation structure 910 which represents the 
structure of the example presentation in box 900. 

40 For each child of a given event, there exists one 

LinkNode or CondNode on its child list. In Fig. 9B 
event E1 901 contains two children, a command C1 
902, and another event E2 903. Present on E1 's child 
list are two LinkNodes 91 1 and 915 each pointing to 

45 one of the children. Likewise, the child list of event E2 
903 contains two elements. The first is a LinkNode 
921 pointing to the command C2 904, and the second 
is a CondNode 919 pointing to the command C3 905. 
Command C3 905 represents the Conditional Goto 

so icon as shown in block 900 of Fig. 9A. Since the action 
of the Conditional Goto requires a partner to be spe- 
cified, the CondNode contains a member 970 (Fig. 
9A) which points to an event or command defined 
elsewhere in the presentation. In this example, the 

55 referenced icon is the command C1 902. 

Referring again to Fig. 9A, each icon which is a 
child of another has at least one member on its parent 
list 950, 955 and 957. This list may contain only Link- 
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Nodes and is maintained to allow easy tracking of all 
points in the presentation that refers to each icon. The 
first element on the list must be a pointer to the event 
which contains a LinkNode to the child on the event's 
child list. These are marked as "ActionLink" Link- 
Nodes 912, 914, 918 and 920. This example shows 
several one element parent lists (event E2 903, com- 
mand C2 904, and command C3 905). 

Any subsequent LinkNodes on an icon's parent 
list represent non-parental references to the icon and 
are marked as ReferenceLink LinkNodes. This setting 
reflects that the event pointed to contains a LinkNode 
on its reference list referring to this icon. Only the par- 
ent list of command C1 901 contains more than one 
LinkNode, because this is the only icon in the example 
that is referenced from some other point in the presen- 
tation (by the Conditional Goto C3 905). The Referen- 
ceLink LinkNode 913 further marks that the event 
pointed to has at least one CondNode on its child list 
that points to the icon 902 containing the Reference- 
Link LinkNode 913 on its parent list 955. Only events 
contain reference list members, which may contain 
only LinkNodes, each one pointing to the non-child 
icons referred to by all of the Cond Nodes on the 
event's ActionLisL For example, as illustrated in Fig. 
9 A, the event E2 903 has a reference list which con- 
tains LinkNode 916 which points to the command C1 
902. 

Referring again to Fig. 9B, most icons may only 
be defined by opening their requester in the flow editor 
210, specifying the desired information and choosing 
the OK button. This information is stored either in the 
Event/Command structure, or in a block of data point- 
ed to by the specific data pointer. This pointer may in 
fact point to a list of nodes, each storing part of the in- 
formation specified by the icon. The majority of the in- 
formation is stored outside of the Event/Command 
structure to allow these structures to be as small as 
possible. 

The command C1 902 is an animation icon which 
will show the animation named "Example. AnimFile" in 
a loop 3 times in paused mode. Likewise the speak 
icon contains a data block defining all of the attributes 
of the phrase to be spoken. This is shown in Fig. 9B 
where the specific data pointer 956 of command C1 
902 points to the specific data block 940 which stores 
information specific to the actions of the animation 
icon (shown in block 900 of Fig. 9A) as set by the user 
(described below). Similarly, the specific data pointer 
958 of command C2 904 points to the specific data 
block 941 the action of a speech icon (shown in block 
900 of Fig. A). 

Both events shown in the diagram contain at least 
one expression 942, 943, and 944. These are stored 
in distinct data blocks, marked as expressions, which 
contain the string version of the expressions. When 
the module event is encountered by the evaluator 240 
during presentation, each of the expressions is eval- 



uated, defining or redefining variables to be used 
elsewhere in the presentation. 

Expression data blocks are also used by all Con- 
d Nodes which point to commands that define condt- 
5 tional expressions for certain icons (e.g., conditional 
goto, If-then, or If-then-else). This is shown in Fig. 9B 
where the CondNode 919 points to the expression 
data block 945. 

to D. The Authoring System 

The preferred implementation of the present in- 
vention provides users with an authoring system in 
which users can create presentations having a struo 

15 ture of the type described in Figs. 9A - 9B using icons 
from the submenus (Figs. 5A - 5F) and evaluate the 
created presentations. 

As illustrated in the flow diagram of Fig. 24, the 
user selects an icon from one of the icon submenus 

20 and the preferred implementation receives an indica- 
tion of the user's selection (step 2410). Based upon 
the user's selection of a particular one of the icons in 
the submenus, the preferred implementation then 
generates a data structure in the memory of the plat- 

25 form 100 (Fig. 1) associated with the selected icon 
(step 2420). As discussed above, each icon repre- 
sents an action or operation to be performed by the 
CPU 102 of the platform 100 during the evaluation 
process. Additionally, one or more data structures 

30 corresponding to selected icons form a presentation. 

After the data structure for a selected icon has 
been generated, the preferred implementation then 
displays on the GRID 310 in the display screen 122 
an image representing the selected icon at the posi- 

35 tion in the GRID 31 0 selected by the user (step 2430). 
After the user selects an icon and places it in the GRID 
310 and defines its attributes, the user may evaluate 
the data structure to perform the action represented 
by the data structure for each selected icon (step 

40 2440). 

E. The Editing Session (Flow Editor) 

Fig. 10 fllustrates a block diagram of the flow edi- 
45 tor 21 0 of Fig. 2 and the relationship of the three com- 
ponents of the flow editor 210: the icon menu 1010, 
the edit window handler 1020, and the icon requester 
handler 1030, to the software components of the pre- 
ferred implementation identified in Fig. 2 and the com- 
50 puter system components first identified in Fig. 1. In 
other words, Fig. 10 illustrates that the icon menu 
1010 of the flow editor 210 is connected to the edit 
window handler 1020 and to no other components of 
the preferred implementation. The icon menu 1010 
55 however is connected to the disk drive 1 05, the mouse 
110, and the keyboard 115 of the platform 100 (Fig. 
1). Others skilled in the art may develop other meth- 
ods of compartmentalizing the functions and opera- 
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tions of the flow editor 210, however, the preferred 
flow editor has been separated into components 
1010, 1020, and 1030 in the preferred implementation 
to explain easily, the preferred operations of the flow 
editor. This is not meant to limit the present invention 
to this particular structure for this flow editor 210. 

The icon menu 1010 of the flow editor 210 has 
been described above with reference to Figs. 4, 5A - 
5F, and 6. 

The edit window handler 1020, on the other hand 
is connected to every component of the preferred im- 
plementation except the expression editor 280. This 
means that when the flow editor 210 is executing in 
the preferred implementation, the edit window handler 
1 020 cannot access the expression editor 280. How- 
ever, the edit window handler 1 020 can access the ap- 
plications mover 210, the database editor 230, the 
evaluator 240, the object editor 250, the videodisc 
controller 260, and the help system 270. The edit win- 
dow handler 1020 is also connected to every compo- 
nent as the icon menu 1010 by virtue of them both be- 
ing a part of the flow editor 210. 

The last component of the flow editor 210 is the 
icon requester handler 1030. The icon requester han- 
dler 1030 is used to define or fully describe icons (by 
creating icon requesters) selected by the user during 
an editing session. For example, if, during an editing 
session, a user selects the control icon 420 from the 
main icon menu 400 (Fig. 4) and enters the control 
icon submenu 500 (Fig. 5A) and selects the if-then 
icon 506 to be inserted into the presentation on the 
GRID 310, the user must also define this icon using, 
in this case, the appropriate icon requester for the if- 
then icon. This identifies the condition in which the 
user wishes the presentation to perform the "then" or 
partner icon of the if-then icon. 

Like the other components of the flow editor 210, 
the icon requester handler 1030 is connected to the 
disk drive 105, the mouse 110, and the keyboard 115 
of the computer system 1 00 (Fig. 1 ). The icon request- 
er handler 1030 is also connected to the evaluator 
240, the object editor 250, the videodisc controller 
260, the help system 270, and the expression editor 
280 of the preferred implementation. That is, when the 
user has selected an icon from the icon menu and 
places the icon in a presentation in the GRID 31 0 and 
enters the icon requester window of the preferred im- 
plementation, the user can, from the icon requester, 
access the appropriate one(s) of these five compo- 
nents of the preferred implementation. Each of these 
components, except the help system 270, will be de- 
scribed more fully below. 

Referring to Figs. 11A- 11G the operations of the 
edit window handler 1020 during an editing session 
will be described. 

When the user begins the processing of the pre- 
ferred implementation, the processes 1100 of the edit 
window handler 1020 are automatically performed. 



First, as illustrated in Fig. 10A, the edit window han- 
dler 1020 opens the edit screen (step 1 101). The edit 
screen is an area of the display screen 122 which in- 
cludes zero, one or more flow windows, the icon me- 

5 nus (Figs. 4 and 5A - 5F) along the bottom of the dis- 
play screen 122 and the main system menu along the 
top of the display screen 122 (not shown). 

The edit window handler 1 020 then displays in the 
edit screen the main icon menu 400 (Fig. 4) (step 

10 1 1 03) and opens a flow window (step 1 1 05). The flow 
window is initially untitled. The flow editor then awaits 
a user action (step 1 107) at which point the user may 
retrieve a presentation previously created from the 
disk drive 105 (Fig. 1), begin creating a new presen- 
ts tation in the flow window 300 or initiate some other op- 
eration of the preferred implementation, e.g., execute 
database editor. A user action may be initiated by pos- 
itioning the cursor using the mouse 1 1 0 on a selected 
area of the display screen 122 and then presses the 

20 left mouse button 113 to select an operation of the edit 
window handler 1020. User action may also be imple- 
mented using other means, e.g., right mouse button 
1 12 or keys on the keyboard 1 15, as described below. 
When a user action is input the edit window han- 

25 dler 1020, responds by performing the requested 
function. If the user is in the edit window handler 1020 
and clicks the left mouse button 113 while the cursor 
is inside of the GRID 310 (step 1109), then the oper- 
ations of the edit window handler 1020 continue with - 

30 step 1140 in Fig. 11B. If the click is outside of the z 
GRID 310, and not on top of any of the icons in the 
icon menus, the click is ignored. The edit window han- 
dler 1020 is only concerned with user actions inside 
flow windows containing a GRID 310. 

35 Fig. 1 1 B shows the flow of operations of the edit 

window handler 1020 used to insert or edit icons in the 
GRID 310. First, the edit window handler 1020 deter- 
mines whether it is presently in the collect mode (step 
1 140). The collect mode is when the user is selecting 

40 a group of existing icons for rearrangement in the 
GRID 31 0. If the edit window handler 1 020 is not in the 
collect mode (step 1140), then the edit window han- 
dler 1020 determines whether the user has clicked on 
a box in the GRID 310 which already contains an icon 

45 (step 1141). If the user has not clicked on a box in the 
GRID 310 containing an icon (step 1141), then the 
edit window handler 1 020 determines whether any 
icon in the GRID 310 has been selected (step 1 142). 
If no, then the operation of the edit window handler 

so continues with step 1107 of Fig. 11 A. Otherwise, the 
edit window handler 1 120 unselects the current icon 
(step 1 143) and continues with step 1 107 of Fig. 1 1A. 

If the user has clicked on a box in the GRID 310 
which contains an icon (step 1 141), then the edit win- 

55 dow handier 1020 determines if this icon is currently 
selected (step 1144). Selected icons are icons that 
appear highlighted in the GRID 310. Unselected icons 
are not highlighted in the GRID 310. If so, and thesec- 
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ond click was within a predetermined time period 
(step 1145), then the icon requester handler 1030 is 
initiated for the selected icon (step 1 146). Once the 
operations of the icon requester handler (discussed 
below) are complete, the flow editor returns to step 
1 107 of the edit window handler 1020 of Fig. 1 1 A. If 
the user did not double click on the icon within the pre- 
determined time period (step 1 145), then the edit win- 
dow handler 1020 continues operation with step 1 107 
of Fig. 11 A. 

If the user has not clicked on the currently select- 
ed icon (step 1144), then the edit window handler 
1 020 unselects the previously selected icon and then 
selects the currently selected icon from the GRID 310 
(step 1147). After the new icon is selected, the edit 
window handler 1 020 determines whether the user 
wishes to initiated a dragging action of the selected 
icon (step 1146) A user initiates a dragging action by 
holding the left mouse button 113 down while the cur- 
sor is on top of the selected icon. If no dragging action 
has been requested (step 1 148) then the edit window 
handler continues with step 1107 of Fig. 11 A. Other- 
wise, if the user wishes to drag the selected icon (step 
1148), then the edit window handler 1120 creates a 
draggable object of the selected icon and permits the 
user to move the icon until the mouse button is re- 
leased (step 1 149). After the icon is dragged to a new 
box in the GRID 31 0, the edit window handler contin- 
ues operation in step 1 107 of Fig. 11 A. 

Otherwise, if the edit window handler 1 020 is in 
the collect mode (step 1 140) then the processes of the 
edit window handler continue with step 1150 of Fig. 
11 C. The operations of the collect mode of the edit 
window handler 1020 begin with first determining the 
logical minimum and maximum number of icons col- 
lectable in both the horizontal and vertical directions 
and generating in the GRID 310 the collection rectan- 
gle with which the user initiates the collection process 
when the user clicks the left mouse button 113 (step 
1 150). Then edit window handler 1020 draws and re- 
draws the collection rectangle in response to mouse 
movements until the left mouse button 1 1 3 is released 
(step 1 151). Then edit window handler 1020 presents 
the user with a requester to verify the collection region 
specified in the collection rectangle (step 1152). The 
edit window handler 1120 determines whether the 
user has confirmed the collection of the icons in the 
region (step 1153). If yes, the edit window handler cre- 
ates a module icon (as a parent icon), inserts the mod- 
ule icon as the first icon in the selected group and 
moves all of the selected icons within the collection re- 
gion to children icons of the new module icon (step 
1154). When the operations of the collect mode are 
complete or if the user does not confirm the collection 
(step 1 152), then flow of control of the edit window 
handler 1020 returns to step 1 107 of Fig. 10A to await 
a user action. 

Otherwise, the edit window handler 1 020 determi- 



nes if the user has positioned the cursor on the display 
screen 122 in a predetermined location and has 
pressed the arrow keys 345 and 350 of the flow win- 
dow 300 (or the arrow keys on a conventional key- 

5 board) or the scroll bars 335 and 340 of the flow win- 
dow (step 1111). If yes, the edit window handler 1020 
will move the viewable portion of the presentation on 
the GRID 310 in the flow window 300 in the requested 
direction (step 1113) and then redisplay the flow win- 
to dow 300 in accordance with the user's request (step 
1117). The edit window handler 1020 then returns to 
step 1107 to await the next user action. 

On the other hand, if the user positions the cursor 
in the flow window 300 on the display screen 122 in 

15 the resize window gadget 355 (Fig. 3) and resizes the 
window (step 1115), then the edit window handler 
1020 redisplays the resized flow window 300 (step 
1117). In the preferred implementation, the resizing 
process is performed by the operating system of the 

20 platform 100. The edit window handler 1020 then re- 
turns to step 1 107 to await the next user action. 

If the user selects the telescoping action from the 
main system menu along the top of the display screen 
122 (step 1119), then the edit window handler 1020 

25 continues with step 1 1 60 of Fig. 1 1 D. In the telescop- 
ing option, the user can condense child icons into their 
parent icons to conserve space on the GRID 310. To 
perform the telescoping function, the edit window 
handler first determines whether the current icon se- 

30 lected by the user is a parent icon (step 1 1 60). If no, 
then the edit window handler ends the telescoping op- 
eration and returns to step 1107 of Fig. 11 A. 

If the current icon is a parent icon (step 1160), 
then the edit window handler determines whether the 

35 current icon's children are visible (are presently being 
displayed in the GRID 310) (step 1161). If the current 
icon has children being displayed in the GRID 310, 
then the edit window handler 1020 finds the first child 
icon for the current icon (step 1162) and marks the 

40 child icon as non-displayed. This informs the edit win- 
dow handler 1020 that the marked icon should not be 
displayed in the GRID 310. 

After the child icon is marked, the edit window 
handler 1020 then determines whether the next icon 

45 in the GRID 310 is a sibling icon to the marked child 
icon involved in the telescoping operation (step 1 164). 
If yes, then this sibling icon is marked as a non-dis- 
played icon (step 1163) and the edit window handler 
1020 again continues with step 1164. If the next icon 

so the GRID 310 is not a sibling icon to the child icon 
(step 1 164), then the edit window handler 1020 redis- 
plays the GRID 310 with the child icons of the parent 
icon selected in step 1 160 no longer displayed in the 
GRID 310 (step 1168). The edit window handler 1020 

55 then continues with step 1 107 of Fig. 1 1 A. 

Otherwise, if the current icon's child icons are not 
visible in the currently displayed GRID 310 (step 
1 161), then the edit window handler 1020 locates the 
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first child icon of the current icon (step 1165) and 
marks the child icon as displayed (step 1 166) in order 
to display the child icon on the GRID 310. The edit 
window handler then determines whether the next 
icon in the GRID 310 is a sibling of the marked child 
icon (step 1167). If yes, then this child icon is also 
marked for display (step 1 166). If the next icon in the 
GRID 310 is not a sibling of the marked child icon 
(step 1 167), then the edit window handler 1020 redis- 
plays the GRID 310 (step 1 168), completes the tele- 
scoping function, and returns to step 1 107 of Fig. 1 1 A. 

If the user in the edit window handler 1 020 selects 
the function of the edit window handler 1020 to drag 
an icon from the GRID 310 to the trashcan icon 410 
(Fig. 4) to delete the dragged icon (step 1121), then 
the operation of the edit window handler 1 020 illustrat- 
ed in Fig. 1 1 E to delete the icon is performed. 

First, the edit window handler 1020 begins the 
icon deletion process by removing the selected icon 
from the presentation structure presently displayed in 
the GRID 310 (step 1170). Next the edit window han- 
dler 1020 determines whether the deleted icon is a 
parent icon (step 1 1 71 ). If the deleted icon is a parent 
icon (step 1171), then the edit window handler 1020 
finds the first child icon of the deleted parent icon (step 
1 172) and then removes that child icon from the pre- 
sentation structure (step 1 173). If this child icon is also 
a parent icon (step 1174), then the edit window han- 
dler returns to step 1172 to find the first child icon of 
this parent icon. This is a recursive process which is 
a conventional programming function. 

If the child icon is not a parent icon (step 1174), 
then the edit window handler 1020 determines wheth- 
er the next icon in the presentation structure is a sib- 
ling icon to the deleted child icon (step 1175). If yes, 
then the sibling icon is removed from the presentation 
(step 1173) and the edit window handler 1020 deter- 
mines whether this removed icon is a parent icon 
(step 1 1 74). If the next icon in the presentation is not 
a sibling of the child icon that was removed with its 
parent icon (step 1 175), then the edit window handler 
1020 determines whether there are any remaining 
icons visible in the GRID 310 of the flow window 300 
(step 1176). 

If there are icons remaining in the GRID 310 (step 
1176), then the edit window handler redisplays the 
GRID 310 without the deleted icon (step 1180). Other- 
wise, the edit window handler determines if there are 
any icons remaining in the presentation currently be- 
ing displayed (step 1 177). If there are more icons in 
the displayed presentation, then the edit window han- 
dler 1020 changes the GRID 310 position in the pre- 
sentation to view at least one of the remaining icons 
(step 1 178). If there are no other icons remaining in 
the presentations, the edit window handler 1020 cre- 
ates a module icon and adds the module icon to the 
presentation to duplicate the untitled presentation sta- 
tus (step 1179). After either step 1178 or step 1179, 



the edit window handler 1020 redisplays the GRID 
310 in the flow window 300 and then returns to step 
1107 of Fig. 11A. 

In Fig. 11 A, if the user selects an icon for place- 

5 ment in the GRID 31 0 (step 1 123), then the operation 
of the edit window handler continues with step 1181 
of Fig. 1 1F In this case, the edit window handler 1020 
first determines whether the selected icon is coming 
from another GRID 310 or being copied from another 

10 part of the same GRID 310 (step 1181). If yes, then 
the edit window handler 1020 makes a copy of the 
icon and all of its children, if any, for insertion into this 
GRID 310 (step 1182). 

If the icon is not coming from another GRID 310 

15 or another point in the same GRID 310 (step 1181), 
then the icon is coming from an icon submenu and the 
edit window handler 1020 determines whether the 
user's placement of the icon in the GRID 310 is valid 
(step 1183). After making a copy of the icon and its 

20 children (step 1182), the edit window handler 1020 
also determines whether placement of the icon (and 
its children) is valid (step 1 1 83). In determining wheth- 
er the placement of an icon is valid, the edit window 
handler 1020 considers whether the new or copied 

25 icon can be a child, mate, or sibling. 

If the placement of the new icon is not valid, then 
the edit window handler 1020 deletes the hew icon 
and any children if the new icon was one which was 
copied from this or another GRID 310 or selected from 

30 an icon submenu (step 1190). Subsequently, the edit 
window handler returns to step 1107 of Fig. 1 1A. 

Otherwise, if the placement of the new icon is val- 
id (step 1183), then the edit window handler 1020 
must consider whether the new icon is being moved 

35 from another part of the same GRID 310 (step 1184). 
Since an icon that is being moved (not copied) from 
one position to another position in the same GRID 310 
and the new position cannot be located in the children, 
grandchildren, etc. of the original position, the edit 

40 window handler 1020 determines whether the new 
position for the copied icon is a new descend ent of the 
original (step 1 185). Once the new position is known, 
the child list of the original icon is checked to deter- 
mine whether new position is a descendent of the 

45 original (step 1185). If yes, the edit window handier 
1020 terminates the operations of Fig. 1 1F and con- 
tinues with step 1107 of Fig. 11A. However, if the new 
position is not inside this region of the presentation, 
the move is val id (step 1 1 85) and the ed it window han- 

50 dler 1020 removes the icon from the original position 
in the GRID 310 (step 1 186). Then, or if the icon being 
moved is not from another part of the same GRID 310 
(step 1185), the edit window handler 1020 adds the 
new icon at the requested position in the GRID 310 

55 (step 1187). 

If the icon being added to the presentation is one 
coming from an icon submenu and one which will ref- 
erence another icon (e.g., a call, goto, or conditional- 
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goto), a referencing placeholder icon is needed (step 

1188) . If no, then the operations of the edit window 
handler 1020 continues with step 1107 of Fig. 11A. 
Otherwise, the edit window handler 1020 creates a 
temporary command which is marked as this refer- 
encing placeholder icon and is added to the presen- 
tation until the referencing process is completed (step 

1 189) . Thereafter, the operations of the edit window 
handler 1020 continue with step 1107 of Fig. 11 A. 

As described above, the edit window includes a 
menu from which the user may select, using the 
mouse 110, certain options. In step 1 125 of Fig. 1 1A, 
the edit window handler 1020 determines whether the 
user has selected the open option form the edit win- 
dow menu. If yes, then the edit window handler 1020, 
opens another flow window and displays the new flow 
window smaller and in front of all other previously dis- 
played windows. The user may have as many win- 
dows open on the display screen 1 22 at the same time 
as the platform 100 is capable of accommodating. Af- 
ter displaying the new flow window, the operation of 
the edit window handler 1020 then returns to step 
1 107 to await the next user action. 

If the user action dicks on the close window gad- 
get 315 within a flow window 300 (step 1 129), then the 
edit window handler 1020 continues operation in Fig. 
1 1G. As illustrated in Fig. 1 1G the edit window handler 
1020 of this invention first determines whether the 
flow window 300 selected by the user to be closed has 
been edited since the last time it was saved (step 
1 191). If no, then the edit window handler 1020 merely 
closes the current flow window (step 1196) and re- 
turns to Fig. 11A to await the next user action (step 
1 107). 

Otherwise, if the flow window 300 has been edit- 
ed (step 1191), then the edit window handler 1020 
generates on the display screen 1 22 a message to the 
user to select either that the flow window be closed or 
saved, or to cancel the request to close the flow win- 
dow (step 1 1 92). If the user selects cancel from the 
generated message (step 1 193), then the operation of 
the close window gadget 31 5 is terminated and the 
edit window handler 1020 operation continues in Fig. 
11A to await the next user action (step 1107). If the 
user selects the save option (step 1 194), then the edit 
window handler 1020, initiates the conventional oper- 
ation of saving the presentation to the disk drive 105 
(Fig. 1 ) and the flow window 300 is closed (step 1 1 96). 
The operation of the edit window handler 1020 then 
continues in Fig. 1 1 A by awaiting the next user action 
(step 1107). Otherwise, if the user has not selected 
the cancel or save option, the user selected the close 
option and the edit window handler 1020 closes the 
flow window 300 (step 1 196) and then continues op- 
eration in Fig. 1 1 A by awaiting the next user action 
(step 1107). 

If the user selects the quit option from the menu 
of the edit window (step 1131), then the edit window 



handler 1020 determines whether there are any flow 
windows open (step 1 1 33). If yes, then the operations 
of Fig. 11G (described above) are executed. After re- 
turning from the operations of Fig. 11G, the edit win- 

5 dow handler 1 020 determines whether the open flow 
window has been closed (step 1135). If yes, then the 
edit window handler 1020 determines whether there 
are any open windows remaining on the display 
screen 122 (step 1133). This process continues until 

10 all open flow windows have been closed. If the open 
flow window did not get closed, then the operation of 
the edit window handler 1020 returns to step 1 107 to 
await the next user action. 

On the other hand, if the user selected the quit op- 
ts tion from the menu (step 1 131) and all flow windows 
are closed (step 1 1 33), then the operations of the edit 
window handler 1020 are complete and the edit 
screen is closed. 

Icons coming from the icon menu are handled by 

20 the edit window handler 1020 and then the icon re- 
quester handler 1030. Fig. 12 is a flow diagram 1200 
depicting the flow of operations of the icon requester 
handler 1030. 

After the icon requester handler begins operation, 

25 it determines whether the selected icon is a referenc- 
ing placeholder icon (step 1205). A referencing place- 
holder icon is an icon which must be replaced by the 
image of a partner icon. If yes, then the icon requester 
handler asks whether the user wishes to pick an icon 

30 to be referenced (step 1210) which, if not selected by 
the user, causes the operation of the icon requester 
handler 1030 to end (step 1285). If the user does wish 
to select the icon to be referenced (step 1210), then 
the operation of the icon requester handler 1 030 con- 

35 tinues by setting the internal referencing select status 
switch (step 1240). The icon requester handler 1030 
keeps an internal state that represents whether a ref- 
erence process is being completed. 

When the user begins referencing, the switch is 

40 set, and the icon requester handler 1 030 is exited until 
the next double-click on an icon in the GRID 310. The 
next entry into the icon requester handler 1030 
checks if the switch is set and if so, attempts to com- 
plete the referencing process. After the referencing is 

45 complete, the switch is cleared and the operation of 
the icon requester handler 1030 is also complete 
(step 1285). 

If the selected icon is not a referencing placehold- 
er (step 1205), and if the icon requester handler 1030 

so is currently in the referencing select mode (step 
1220), then the icon requester handler determines 
whether the selected icon is a valid reference partner 
or originating icon (step 1225). If no, the icon request- 
er handler generates on the display screen the appro- 

55 priate message informing the user that the selection 
is invalid for the appropriate reason (step 1230). A call 
may only reference a subroutine icon, a goto may only 
branch to one of the children of its ancestors, etc. 
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Then, if the user wishes to continue referencing (step 
1235), then the operation of the icon requester han- 
dler 1030 is complete (step 1285). Otherwise, if the 
user does not wish to continue referencing, then the 
icon requester handler 1030 clears the referencing 
select status (step 1240) and then completes its op- 
eration (step 1285). 

Otherwise, if the icon requester handler 1 030 de- 
termines that the selected icon is a valid reference 
partner for the original referencing icon (step 1225), 
then the icon requester handler 1030 asks if the user 
wants to reference the current icon (step 1245). If yes, 
then trie icon requester handler 1030 completes the 
referencing process and clears the referencing select 
status (step 1250) before completing (step 1285). If 
the user does not want to reference the current icon 
(step 1245). then the icon requester handler 1030 
continues by asking if the user wishes to continue ref- 
erencing (step 1255). If yes, then the icon requester 
handier 1030 completes operation (step 1285). Other- 
wise, the icon requester handler 1030 clears the ref- 
erencing- select status (step 1260) and completes op- 
eration (step 1265). 

If the selected icon is not a referencing placehold- 
er (step 1205) and if the icon requester handler 1030 
is not currently in the referencing select mode (step 
1220>. trten the tcon requester handler determines 
whether the selected icon is a conditional icon (step 
1 265). H yev then the icon requester handler 1 030 ini- 
tiates the expression editor (step 1270). The opera- 
tions of the expression editor of the preferred imple- 
mentation are discussed below. 

If the «con is not a referencing placeholder icon 
(step 1205). the icon requester handler 1030 is not in 
the referencing' select mode (step 1220) and the se- 
lected icon t% not conditional (step 1265), then the icon 
requester handler determines whether the icon has an 
icon requester (step 1275). If no, then the operation 
of the icon requester handler 1 030 is complete (step 
1285) Otherwise, the icon requester handler 1030 
calls a routine which handles the requester operation 
for each con (Mep 1280). 

White the process to support the requester for 
each of the different icons is unique to the icon type, 
the process dearly divides into three parts. First if in- 
formation has been saved in a specific data block and 
attached to the presentation structure (see Figs. 9A 
and 96). this information is extracted and used to set 
the state of all the buttons and other gadgets on the 
newly opened requester. If no information has previ- 
ously been saved, meaningful default values are set 
in the requester. Second, the requester support code 
monitors the user's actions, updating gadget settings 
when needed and verifying user input. When the user 
signals that they are satisfied with the current settings 
by clicking the 'OK* button 895 (Fig. 8), the informa- 
tion currently shown in the requester is saved in a spe- 
cific data block (a new one is created if needed) and 



the block is attached to the icon. If the Cancel button 
880 is depressed, the information in the requester is 
discarded, and the incoming specific data block (if 
any) is retained. The requester is then closed, and the 
5 icon requester handler 1030 operation continues. 

When the called routine has completed its oper- 
ation, the icon requester handler 1 030 completes its 
operation (step 1285). 

10 F. The Expression Editor 

As described above with reference to Fig. 2, the 
expression editor 280 of the preferred implementation 
is used to specify expressions which may define va- 
ts riables. Fig. 13 illustrates a preferred example of the 
expression editor window 1300 as displayed on the 
display screen when the user operates the expression 
editor. 

The expression editor window 1 300 includes sev- 

20 eral fields to input information, gadgets, and buttons. 
The function performed by the close window gadget 
315, the drag bar gadget 320, the window-to-front 
gadget 325, the window-to- back gadget 330, the help 
button 870, the cancel button 880 and the OK button 

25 895 of the expression editor window have already 
been described with reference to Figs. 3 and 8. 

The expression editor 280 may be entered in one 
of two modes. When a condition is needed (for the 
icons having a diamond shape, or for the loop, wait 

30 condition, etc.), only one string (the condition) may be 
entered. In this mode, the up button 1305, down but- 
ton 1 310, and insert button 1 320 are not valid and are 
displayed ghosted. When the expression editor is en- 
tered from either the module, subroutine, or X/Y icon, 

35 any number of expressions may be specified. In this 
mode, the up button 1305 and down button 1310 but- 
tons allow the user to move through the expressions 
defined by the icon. Normally, new expressions may 
simply be added to the end of the list If, however, the 

40 user wants a new expression to be inserted at a par- 
ticular position, the insert button allows the expres- 
sion to be inserted. 

The backspace button 1325 deletes the character 
to the left of the cursor in the expression field 1340 

45 and the delete button 1 330 permits the user to delete 
the character under the cursor. Finally, the cancel but- 
ton 880 instructs the editor to discard any modifica- 
tions made, and return only the expressions defined 
when the editor was entered. The expression editor 

so window 1300 also has a clear button 1335 which 
clears the current expression being displayed in the 
expression field 1340. 

Additionally, the expression editor window con- 
sists of five separate regions: the functions region 

55 1 380, the variables region 1370, the iogical operators 
region 1380, the arithmetic operators region 1345, 
and the expression field 1340. The functions region 
1320 contains a list of standard arithmetic and string 
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functions. The user may scroll up and down through 
the functions list using the up and down arrow buttons 
1385 to the right of the functions list. The user may 
also scroll up and down through the functions list us- 
ing the positioning bar 1390 which allows more rapid 
movement through the list than the buttons 1385. The 
user may select one of the functions from the func- 
tions list using the mouse 110 and left mouse button 
113. 

The variables region 1370 of the expression edi- 
tor window 1300 is used to list all of the local and glo- 
bal variables that are available for use. Again, the user 
may scroll up and down through this list using the up 
and down arrow buttons 1386 to the right of the list. 
The user may also scroll up and down through the va- 
riables list using the positioning bar 1395 which allows 
for more rapid movement through the list than the but- 
tons 1386. The user may select one of the variables 
from the list using the mouse 110 and left mouse but- 
ton 113. 

The logical operators region 1380 of the expres- 
sion editor window 1 300 is used primarily for condi- 
tional icons to set the condition for the icon. For ex- 
ample, to set a condition for an if-then icon, when the 
user selects the icon and places it in the GRID 310, 
the user double clicks on the icon to initiate the icon 
requester handler for the if-then icon. Once the icon 
requester handler 1030 (Fig. 10) is initiated, it invokes 
the expression editor 280 and the expression editor 
window 1300 for the user to select the expression. 
The user then enters, in the expression field 1340, us- 
ing the functions, variables, arithmetic operator, or 
logical operators in the expression editor window 
1300 to create the expression for the if-the icon. 

The arithmetic operators 1 345 are used in the as- 
signment of expressions and as a general purpose 
numerical pad. Finally, as previously suggested, the 
expression field is used to enter the expression for a 
conditional icon. 

The preferred operations of the expression editor 
will now be described with reference to the flow dia- 
gram 1400 illustrated in Fig. 14. 

When the user enters the expression editor 280 
of the preferred implementation of the present inven- 
tion, a window is opened (step 1405). This is conven- 
tional and is generally supported by the operations of 
the system software of the computer system 100 (Fig. 
1 ). After the expression editor window is opened, the 
expression editor determines whether an incoming 
string has been previously specified by the user (step 
1407). If yes, then the incoming string is displayed in 
the expression editor window (step 1409). Otherwise, 
or after the incoming string is displayed in the expres- 
sion editor window 1300, the expression editor awaits 
a user action (step 1411). 

After a user action is detected, the expression 
editor 280 responds to the input user action by first de- 
termining what the user action was and what is the re- 



quired response to that action. In determining what 
the input user action is, the expression editor first asks 
whether the user action was to press a key on the key- 
board (step 1413). If yes, the expression editor con- 
5 tinues by modifying the display string (step 141 5) fol- 
lowed by returning to step 1411 to await further user 
action. 

If the input user action was not a key press (step 
1413), then the preferred expression editor determi- 

10 nes whether the user has clicked (positioned the cur- 
sor in the appropriate location on the display screen 
and pressed the left mouse button 1 13) in the function 
list of the expression editor window (step 1417). If yes, 
the expression editor will add a function to the display 

15 string, add parentheses to the display string, and pos- 
ition the cursor inside the parentheses added to the 
display string (step 1419). The expression editor then 
continues in step 1411 awaiting the next user action. 
Otherwise, the expression editor determines 

20 whether the user has clicked inside the variable list 
(step 1421 ). If yes, the expression editor adds the va- 
riable name from the variable list to the display string 
(step 1423). The expression editor continues at step 
1411. 

25 Otherwise, if the user has clicked on one of the 

symbol or number buttons (step 1425), the expression 
editor adds the symbol or number to the expression 
currently being edited (step 1427). If the user has 
clicked on the help button in the expression editor 

30 (step 1 429), the help display of the help system of the 
preferred implementation is displayed for the user 
(step 1431). Otherwise, if the user clicks on the cancel 
button or the close window gadget (step 1433), then 
the expression performs the necessary operation to 

35 close the expression editor window, destroy the cur- 
rently edited display string, and exit to the flow editor 
returning nothing (if the icon was never previously de- 
fined) to the presentation currently in the GRID 310 
(steps 1439 and 1441). If the expression is entered 

40 from a previously defined icon, selecting cancel re- 
turns the previous meaning. 

Finally, if the user is in the expression editor and 
clicks on the 'OK' button 895 (step 1437), then the ex- 
pression editor window 1300 of the preferred imple- 

45 mentation is closed followed by the operations for ex- 
iting the expression editor 280 and returning to the 
presentation in the GRID 310 with the edited display 
string (steps 1439 and 1441). 

Using the expression editor 280, the user can 

so then add conditions and other expressions to the pre- 
sentation. 

G. The Object Editor 

55 Fig. 1 5 illustrates a block diagram of the preferred 

object editor 250 of the preferred implementation of 
this invention and the relationship of the object editor 
to the disk drive 105, the mouse 110, and the key- 
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board 115 of the computer system 115 (Fig. 1). The 
object editor 250 includes an object creation/specifi- 
cation/editing component 1510, and an object re- 
quester component 1520. Both components of the ob- 
ject editor 250 are connected to the preferred help 
system 270 of the invention so that the help system 
270 can be entered by the user when in either com- 
ponent 1 51 0 or 1 520 of the object editor 250. The ob- 
ject requester component 1520, however, is connect- 
ed to the expression editor 280, while the component 
1510 is connected to the videodisc controller 260. 
Therefore, only the object requester component 1 520 
can access the expression editor 280 (discussed be- 
low). Those skilled in the art may recognize other 
methods for compartmentalizing the functions and op- 
erations of the object editor, however, the preferred 
object editor 250 has been separated into compo- 
nents 1510 and 1520 to explain easily the operations 
of the preferred object editor. This is not meant to limit 
the present invention to this particular structure for 
this editor. 

The object creation/specification/editing compo- 
nent 1510 is used to interactively design, position, and 
edit display objects to be used in a presentation, while 
the object requester component 1520 performs, in a 
manner similar to the icon requesters discussed 
above, the function of defining the object created by 
the user with the component 1 520. 

The operational flow of the object editor 250 will 
now be described with reference to Figs. 16A - 16M 
which is a flow diagram 1600 of the preferred opera- 
tions of the object editor of this invention. 

First, when the object editor 250 begins, it deter- 
mines whether the user entered the object editor 
through the flow window icon (step 1601). If yes, then 
the object editor searches up from the flow window 
icon to find any screen definition icon (step 1602). The 
object editor 220 always attempts to display a back- 
ground screen on the display screen 122 in the same 
mode that will be showing when the current icon is 
evaluated. Thus, when entered from an icon in an pre- 
sentation, the previous siblings, parents and their sib- 
lings are checked for screen-defining actions. When 
a screen-defining icon is found, this screen format is 
used for the background of the object editor 220. 

If a screen icon is found (step 1603) then the ob- 
ject editor 250 opens the screen defined by the found 
icon (step 1604) and then determines whether the 
user has specified a picture (step 1 605). If yes, the ob- 
ject editor asks whether the user wants the specified 
picture displayed (step 1606). If the user wants the 
specified picture displayed (step 1 606), the object edi- 
tor displays the picture (step 1607) and then displays 
any objects associated with the screen icon (step 
1608). Otherwise, if the user does not want the spe- 
cified picture displayed (step 1606), then the object 
editor merely displays the objects associated with the 
selected icon (step 1608). If the user has not specified 



a picture (step 1605), then the object editor merely 
displays the objects associated with the selected icon 
(step 1608). 

Otherwise, if no screen icon is found (step 1603), 

5 the object editor 220 opens a standard edit screen 
(step 1609). After the standard edit screen is opened 
(step 1 609), the object editor determines whether any 
objects are defined by the selected icon (step 1610). 
If yes, the object editor displays the objects associat- 

10 ed with the selected icon (step 1608). Otherwise, the 
object editor 250 informs the user that the editor was 
entered (step 1611). 

Next, the object editor awaits a user action (step 
1 612). When a user action is input to the preferred irrv 

15 plementation of the object editor, the object editor re- 
sponds accordingly as described more fully below. 

If the user selects the screen definition option 
from the object editor menu (step 1613), the object 
editor presents the screen definition requester to the 

20 user, allows the user to specify screen settings, and 
displays the new screen (step 1 61 9). The object editor 
250 then returns to await the next user action (step 
1612). 

If the user selects the screen palette option from 

25 the object editor menu (step 1615), then the object 
editor presents the user with the screen palette re- 
quester, allows the user to specify screen colors in the 
requester and displays the display screen with the pa- 
lette of colors (step 1616). The object editor then re- 

30 turns to await the next user action (step 1612). 

If the user selects the videodisc option from the 
object editor menu (step 1617), the object editor 250 
returns to await the next user action (step 1612). 
If the user chooses to load previously saved ob- 

35 ject definitions by making the proper menu selection 
(step 1622), then the object editor 250 presents the 
user with the Load Display objects file requester al- 
lowing selection of the file to be loaded. The new ob- 
jects are then displayed, erasing any existing objects 

40 on the display screen 122 (step 1 623). The object edi- 
tor then returns to await the next user action (step 
1612). 

If the user chooses the clear objects option from 
the object editor menu (step 1624), then the object 

45 editor 250 determines whether any objects presently 
exists on the display screen 122 (step 1625). If yes, 
then the object editor 250 first confirms with the user 
that wishes to continue (step 1626), and then erases 
all existing objects from the display screen 122 (step 

so 1627). After erasing all existing objects (step 1627) or 
receiving a negative confirmation from the user in step 
1 625, or determining in step 1626 that there are no ob- 
jects on the display screen, the object editor 250 re- 
turns to await the next user action (step 1612). 

55 If the user chooses the preview option from the 

object editor menu (step 1628), then the object editor 
250 enters its preview mode, displaying all objects on 
the display screen as if the present collection was be- 
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ing evaluated at run- time, and responds to the user's 
input until the right mouse button 1 12 is clicked (step 
1 629). The object editor 250 then returns to await the 
next user action (step 1612). 

If the user chooses the redisplay option from the 
object editor menu, (step 1630), then the object editor 
250 redisplays the display screen and all existing ob- 
jects (step 1631). The object editor 270 then returns 
to await the next user action (step 1612). 

If the user chooses the save option from the ob- 
ject editor menu (step 1632), then the object editor de- 
termines whether the current display screen has been 
previously saved under a file name (step 1633). If yes, 
then the object editor 250 saves the current objects in 
the display screen to the file having the same name 
as the previously named file (step 1634). Otherwise, 
the object editor 250 presents the user with the Save 
Display Objects file requester and allows the user to 
select the name for the new objects file (step 1635). 
After the user has selected the new name for the ob- 
ject fie. and saves the currently displayed objects 
(step 1635). the object editor 250 returns to await the 
next user action (step 1612). 

tf the user selects the Save As option from the ob- 
ject editor menu (step 1636), then the object editor 
displays on the display screen the Save Display Ob- 
jects file requester allowing the user to select the 
name of the object file, and saves the current dis- 
played objects to the file (step 1637). The object editor 
250 then returns to await the next user action (step 

1611) . 

tf the user selects the help option from the object 
editor menu (step 1638), then the object editor ini- 
tiates the help system of the preferred implementation 
which generates the appropriate help display (step 
1639). After the user has completed the help, the ob- 
ject editor returns to await the next user action (step 

1612) . 

If the user selects the add (object type) from the 
object editor menu (step 1640), then the object editor 
250 continues in step 1701 of Fig. 16H. 

Mosl objects created by the object editor 270 are 
initially specified by positioning the mouse at the de- 
sired initial position, depressing the left mouse button 
113. dragging the mouse until the object is the desired 
size and shape, and releasing the left mouse button 
113. This can be envisioned for rectangles, circles, 
etc. The only object which requires more than two 
points to be specified is a polygon. Editing a polygon 
is performed by clicking at the initial point, moving to 
the second point clicking again, repeating the move 
and clicking steps until the desired polygon has been 
defined. The definition is completed by clicking the 
right mouse button 112 which connects the last point 
defined with the first, closing the polygon. The right 
mouse button 1 12 is generally viewed to be an abort 
signal from the user. The object editor uses it to abort 
definition of all objects except the polygon, which uses 



the right mouse button 1 1 2 to signal completion as de- 
scribed above. 

Instep1701 of Fig. 16G, the object editor 250 first 
determines whether the object type selected by the 

5 user is a polygon. If the object type selected by the 
user is not a polygon (step 1701 ), the object editor 250 
awaits the next user action (step 1703). If the user 
clicks on the right mouse button 112 (step 1704), the 
functions of the add object type option of the object 

10 editor menu are complete and the flow continues in 
step 1612 (Fig. 16A) where the object editor 250 
awaits the next user action. Otherwise, if the user 
clicks the left mouse button 113 down (step 1 705), the 
object editor 270 awaits the next user action (step 

15 1706). 

If the mouse is then moved (step 1707), then the 
object editor draws a boundary line on the display 
screen 122 which the user then uses to define the ob- 
ject placement and size (step 1 708). The object editor 

20 270 then returns to await the next user action (step 
1 706). If the mouse is not moved (step 1707), but the 
right mouse button 112 is clicked down (step 1709), 
then the functions of the add object type option of the 
object editor menu are complete and the flow returns 

25 to step 1 612 (Fig. 16A) to await the next user action. 

However, if the left mouse button 1 1 3 is released 
(step 1710), then the object editor 250 allocates an 
object of the selected object type and size and dis- 
plays the object on the display screen (step 1711). 

30 The object editor 270 has then completed the add ob- 
ject function and returns to step 1612 (Fig. 16 A) to 
await the next user action. If the left mouse button 113 
is not up (step 1710), the object editor 250 returns to 
step 1706 to await the next user action. 

35 If the user selected the object type as a polygon 

(step 1701), then the object editor continues its oper- 
ations in (step 1720) of Figure 16H and awaits the 
next user action. If the user presses the left mouse 
button 113 down (step 1721), then the object editor 

40 250 draws a point at the current mouse position (step 
1722) and returns to await the next user action (step 
1720). Otherwise if the left mouse button 113 is not 
down and the mouse is moved (step 1 723), then the 
object editor draws a boundary line on the display 

45 screen 1 22 from the last point at which the left mouse 
button 113 was depressed to the current cursor pos- 
ition (step 1724). The object editor then returns to 
await the next user action (step 1720). However, if the 
mouse is not moved (step 1723), and the right mouse 

50 button 1 12 is depressed (step 1725), then the object 
editor 250 determines whether the user has drawn 
more than one point on the display screen 122 (step 

1 726) . If yes, then the object editor allocates the poly- 
gon object for display to the display screen 122 and 

55 displays the object on the display screen 122 (step 

1727) . Then, and if the user did not draw more than 2 
points on the display screen 122 (step 1726), the op- 
erations of the add polygon option of the add object 
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type option of the object editor 250 are complete and 
the flow of control returns to the main object editor 
menu at which point the object editor 250 awaits the 
next user action (step 1612). 

Returning to Fig. 16C, if the user selects the ar- 
range option from the object editor menu (step 1641), 
then the object editor enters the arrange menu option 

flow illustrated in Fig. 161. — — 

First, the object editor 250 awaits the next user 
action (step 1730). If the user clicks the left mouse 
button 113 down over an object (step 1731), and it is 
the first time that user has clicked the left mouse but- 
ton 1 13 down over an object (step 1732), then the ob- 
ject editor 250 positions the object under the mouse 
as the first object in the display list for the current dis- 
play (step 1733). The object editor 250 then returns to 
await the next user action (step 1 730). 

The display list is a list of data structures repre- 
senting the objects. Each data structure contains in- 
formation describing one object and its attributes 
(e.g.. coordinates for positioning on the display 
screen, width, height, and color). 

If this is not the first object clicked upon (step 
1732). the object editor 250 positions the current ob- 
ject under the mouse after the last object arranged 
(step 1 734) and returns to await the next user action 
(step 1 730). tf the left mouse button 113 has not been 
clicked down over an object (step 1731) and the right 
mouse button 112 has been depressed down (step 
1735). the operations of the arrange menu option of 
the object editor 250 have been completed and con- 
trol returns to step 1612 of Fig. 16A to await the next 
user action, tf the right mouse button 112 has not been 
pressed down (step 1735), then the object editor 250 
awaits the next user action in the arrange option. 

If the user selects the copy option from the object 
editor menu (step 1642) (Fig. 16C), then the functions 
of the copy option are performed. The copy option 
functions are illustrated in Fig. 16J. 

The copy actions are initiated by the user select- 
ing the operation from the menu, depressing the left 
mouse button 1 13, dragging the new object to its pos- 
ition and releasing the left mouse button 113. As with 
object definition, this process may be cancelled by 
clicking the right mouse button 112. 

First, the object editor 250 awaits the next user 
action (step 1740). If the right mouse button 112 has 
been depressed (step 1741), then the object editor 
250 cancels the copy option selected by the user main 
object menu to await the next user action (step 1612). 
If the right mouse button 112 has not been depressed 
(step 1741), and the left mouse button 113 is de- 
pressed (step 1 742), then the object editor 250 begins 
dragging the image of the selected object as request- 
ed by the user (step 1743). The object editor 240 then 
returns to await the next user action (step 1 740). If the 
left mouse button 113 is released (step 1744), then 
the object editor 250: 1) allocates a copy of the select- 



ed object, 2) adds a copy of the selected object to the 
front of the display list, 3) gives the object the screen 
coordinates where the image was dragged, 4) makes 
the object the selected object, and 5) displays the se- 
5 lected object (step 1745). The operation of the copy 
menu option of the object editor 250 are now complete 
and control returns to Fig. 16A where upon the object 

editor 250 awaits the next user action (step 1612). If 

the left mouse button 113 has not been released (step 
10 1 744), the object editor 250 redraws the object at its 
current position (step 1746) and the copy procedure 
of the object editor 240 returns to await the next user 
action (step 1740). 

Returning to Fig. 16C, if the user of the object edi- 
ts tor 250 selects the delete option from the object editor 
menu (step 1 643), then the object editor 250 removes 
the selected object from the display list and the dis- 
play screen 122 (step 1644). The object editor then re- 
turns to step 1 61 2 (Fig. 1 6A) to await the next user ac- 
20 tion. 

If the user selects the depth-front option from the 
object editor menu (step 1645), then the object editor 
250 repositions the selected object at the front of the 
display list (step 1646) and awaits the next user action 

25 (step 1612). 

If the user selects the depth-raise option from the 
menu (step 1647) in Fig. 16D, then the object editor 
250 raises the selected object one position above its 
current position in the display list (step 1648). The ob- 

30 ject editor 250 then returns to await the next user aon 
tion (step 1612). 

If the user selects the depth-lower option from the 
object editor menu (step 1649), then the object editor 
250 lowers the selected object one position below its 

35 current position in the display list (step 1650). The ob- 
ject editor then returns to await the next user action 
(step 1612). 

If the user selects the depth-back option from the 
object editor menu (step 1651), then the object editor 

40 250 repositions the selected object at the end of the 
display list (step 1652). The object editor 250 then re- 
turns to step 1612 to await the next user action. 

If the user selects the Info option from the object 
editor menu (step 1653), then the object editor 250 ini- 

45 tiates the requester handler for the selected object 
(step 1654). The object editor 250 then returns to 
await the next user action (step 161 2). if the user se- 
lects the move option from the object editor menu 
(step 1 655), the object editor 250 continues operation 

so instep 1750of Fig. 16K at which point the object edi- 
tor awaits the next user action (step 1750). 

Referring to Fig. 16K, the move option of the ob- 
ject editor 250 will now be explained. First, the object 
editor 250 determines whether the user has de- 

55 pressed the right mouse button 112 (step 1751). If 
yes, the functions of the move option of the object edi- 
tor 250 are complete and flow returns to step 1612 of 
Fig. 1 6A to await the next user action. Otherwise, and 
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if the left mouse button 113 has been depressed by 
the user while in the move option of the object editor 
250 (step 1752), then the usermay begin dragging the 
image of a selected object (step 1 753) and the object 
editor 250 awaits the next user action (step 1750). 
Otherwise, and if the left mouse button 113 is re- 
leased (step 1754), the object editor 250 sets the se- 
lected object's coordinates to its new position in the 
display screen and displays the object in its new pos- 
ition (step 1755). The functions of the move option in 
the object editor 250 are then complete and flow re- 
turns to step 1612 of Fig. 16A to await the next user 
action. Otherwise, if the left mouse button 113 is not 
up (step 1 754), then the object editor 250 redraws the 
object at the current position (step 1756) and awaits 
the next user action in the move menu option (step 
1750). 

Returning to Fig. 16D, the functions of the object 
editor 250 will be described further. If the user choos- 
es the select-front option from the object editor menu 
(step 1656), the object editor 250 makes the first ob- 
ject in the display list the selected object (step 1657) 
and displays the selected object in its selected state 
(step 1658). The object editor 250 then returns to 
await the next user action (step 1612) in Fig. 16 A. 

If the user selects the select-next option from the 
object of their menu (step 1 659), the object editor 250 
selects the object immediately after the selected ob- 
ject in the display list and redisplays the object in the 
select state of (step 1660). The object editor 250 then 
returns to await the next user action (step 1612). 

If the user selects the select preview option from 
the object editor menu (step 1661), the object editor 
selects the object immediately before the selected ob- 
ject in the display list and redisplays the object in the 
selected state (step 1662). The object editor then re- 
turns to await the next user action (step 1612). 

The flow of control of the object editor will now be 
described further with reference to Fig. 16E. If the 
user selects the size option from the object editor 
menu (step 1663), then the operations of the object 
editor 250 continue in Fig. 16L. 

In Fig. 16L, the size function of the object editor 
menu first awaits the next user action (step 1750). If 
the user depresses on the right mouse button 112 
(step 1751), the function of the size option of the ob- 
ject editor are complete. If the user depresses the left 
mouse button 113 (step 1752), then the object editor 
250 draws a boundary line on the display screen out- 
lining the size of the selected object for alteration by 
the user (step 1753). The object editor 250 then re- 
turns to await the next user action. If the mouse is then 
moved (step 1754), the object editor 250 sizes and re- 
draws the boundary lines on the display screen from 
the selected object's beginning point to the current 
mouse position (step 1755), and then returns to await 
the next user action (step 1750). If the mouse is not 
moved (step 1754), the object editor 250 returns to 



await the next user action (step 1750). 

Returning to Fig. 16E, if the user in the object edi- 
tor menu clicks the left mouse button 113 down (step 
1 664), then the functions of the left mouse button op- 

5 tion of the object editor main menu are performed. Fig. 
16M outlines the operation of the left mouse button 
option of the object editor 250. 

First, the object editor 250 determines whether 
the left mouse button 113 clicked over an object (step 

10 1 760). If yes, then the object editor 250 next determi- 
nes whether this object has been selected (step 
1761). If yes, the object editor 250 next determines 
whether the user has clicked the left mouse button 
113 within the predetermined double click time (step 

15 1 762). If no, the functions of the left mouse button op- 
tion of the object editor 250 are complete. If the left 
mouse button 113 has been double clicked within the 
predetermined time period (step 1762), the object edi- 
tor 250 initiates the appropriate requester handler for 

20 the selected object (step 1763). The functions of the 
object requester handler and object requesters for ob- 
jects are substantially the same as those of the icon 
requester handler and icon requesters. The only dif- 
ferences are in the specifics of the definition process 

25 of each object The object editor 250 then has com- 
pleted the left mouse button option. 

If the click of the left mouse button 113 was not 
on the currently selected object (step 1761), the ob- 
ject editor 250 un selects the current object and se- 

30 lects a new object (step 1 764). The new object is then 
the currently selected object. Again, the functions of 
the left mouse option are then complete. 

If the mouse was not clicked over an object (step 
1 760) and the object editor 250 determines that there 

35 is an object currently selected (step 1 765), then object 
editor 250 unse lects the current object (step 1766) 
and then completes the left mouse button 113 func- 
tions. If no object has been selected (step 1765), the 
functions of the left mouse button option are conrv 

40 plete. 

Returning to Fig. 16E, the remmaining functions 
of the object editor 240 will now be described. In step 
1 665, the object editor 240 determines whether the V 
key on the keyboard has been pressed by the user. If 
45 yes, then the add functions of the object editor, descri- 
bed above with reference to Fig. 16G, are performed 
to create a rectangle. After the rectangle object type 
has been added to the object list or the functions of 
the add option of the object editor 240 have been corn- 
so pleted, the object editor returns to step 1 61 2) to await 
the next user action. 

If the user selects the "p" key from the keyboard 
(step 1665), then the functions of the object editor 
continue by adding, using the steps outlined in Fig. 
55 1 6G, to add a polygon object to the display list When 
the functions the add option of the object editor are 
complete (Fig. 16G), the object editor 250 then re- 
turns to await the next user action (step 1617). The 
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same functions are used to add a line object (step 
1666), a circle object (step 1667), in ellipse object 
(step 1 668), a text/variable object (step 1 669), a brush 
object (step 1670), an input field object (step 1671), 
and a text window object (step 1672). 

If, during the object editor execution, the user 
presses the space bar (step 1673), the object editor 
duplicates the last action taken by the user (step 
1674) and then returns to await the next user action 
(step 1612). 

If the user chooses the exit option from the object 
editor menu (step 1675), then the object editor 250 de- 
termines whether the user has entered from the pulled 
down menu (step 1676). If not, then the functions of 
the object editor 250 are complete. If the user has en- 
tered the exit command from the pull down menu (step 
1 676), then the object editor 250 determines whether 
any display objects currently on the display screen 
122 have been modified without those changes being 
saved to a file (step 1677). If not, then the functions 
of the object editor 250 are complete and the user ex- 
ists the object editor. However, if the objects currently 
being displayed have been modified (step 1677), then 
the object editor 250 generates a message on the dis- 
play screen 122 requesting whether the user wishes 
to save the modifications (step 1678). If yes, then the 
object editor 250 saves the objects to a file (step 1 61 9) 
and the functions the object editor are then complete. 
Otherwise the user indicates that he or she does not 
wish to save the changes and the functions of the ob- 
ject editor 250 are complete. 

H. The Database Editor 

The database editor 230 is depicted in Fig. 17 as 
being composed of three parts: the database file cre- 
ation/loading/ deletion component 1780, the key 
specification editor components 1785, and the record 
viewer/editor component 1 790. Although those skilled 
in the art may recognize that other structures for the 
database editor 230 may be used to accomplish the 
same functions performed by the preferred database 
editor 230 of the present invention, the preferred da- 
tabase editor 230 has been compartmentalized into 
these three components 1780, 1785, and 1790 for 
purposes explaining easily the operations of this edi- 
tor. This is not meant to limit the present invention to 
this particular structure for this editor. 

The database file creation/loading/deletion com- 
ponent 1780 performs the combined functions of: 1) 
loading an existing database file, to allow a) editing of 
the file's records by entering the record viewer/editor, 
b) deletion of all information (records) in the file, c) 
modification of the record structure (after deleting any 
existing records) or 2) specification of a new record 
structure and creation of the file to allow records to be 
added to the database file. The key specification edi- 
tor 1 785 allows initial or derivative specification of the 



key to be used when accessing the records in the da- 
tabase and the record viewer/editor 1790 allows the 
user to move throughout the records in the database, 
viewing and possibly editing any of the information 

5 contained in the records. 

After selecting the database option from a menu 
of the preferred implementation, the user is presented 
with a database window 1800, like the one depicted 
in Fig 18, which allows the user to define a new data- 

w base file format, or the loading of an existing database 
file format. In Fig. 18, the database editor window 
1 800 has several familiar gadgets and buttons which 
will have already been discussed and will therefore 
not be discussed again. 

15 If an existing database file is to be accessed, the 

name of the file may be specified in the filename field 
1 805 and the file is loaded. Once loaded, the structure 
of the file is displayed in the middle of the database 
window 1800 in the database structure field 1810, 

20 showing the name, type, and size of each of the fields 
in the records contained in the database file. 

New database files are created by the user by first 
defining each field of a record in the database file in 
the structure definition field 1810. This requires the 

25 user to define the name, type, and size of the fields 
using fields and the gadgets on the right of the data- 
base window 1800. To define a typical record in the 
database file, the user first enters the name of the field 
by selecting the name field 1815 and entering the 

30 name in the name field 1815. Then the user selects 
the type button 1820 until the selected field type is 
shown in the type field 1820a. The user then selects 
the size of the field in the record by selecting the size 
gadget 1 830 and entering the number in the size field 

35 1 830a specifying the size of the field. If the new field 
in the record is a numeric field then the user selects 
the "dec" or decimal gadget 1 840 to enter the number 
of decimal points for the number in the numeric field 
1840a. 

40 When the field information is complete, it may be 

inserted into the list 1840 on the left of the database 
window 1800 by clicking in the insert button. This 
process is repeated until each of the fields is defined. 
Once inserted into the list, the fields may be moved 

45 about the record by using the move button 1 860 in the 
database window 1800. 

The delete gadget 1 850 permits the user to delete 
a field in the record, the insert gadget 1 860 permits the 
user to insert a new field into the fields displayed in the 

so record display area 1 81 0. The move gadget 1 870 per- 
mits the user to move a field from one location in the 
record to another location in the record and the clear 
gadget 1880 permits the user to clear the current in- 
formation in the record display area 1810. 

55 When the record structure is complete, a name 

may be specified for the new database file and the file 
is created by selecting the create button 1885. This 
presents the user with options to delete the current 
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database file (gadget 1890), edit data in the current 
database file (gadget 1895), or edit keys (gadget 
1 897) for the current database file. Keys are used for 
quick access to the records in the database file by 
tracking the contents of selected fields in the records. 
The exit button 1898 is used to exit the current win- 
dow. 

Key editing in the database editor 230 is per- 
formed after the edit keys button 1897 is selected. A 
list of fields is then displayed on the left in the key win- 
dow, an example of which is shown in Fig. 19. For 
each field to be used as a key, the user double clicks 
on its entry in the list on the left in the key fields list, 
entering it into the list on the right list 1 920. The order 
of the fields may be changed by using the delete but- 
ton 1930, the insert button 1940, and move buttons 
1950. When the key selection process is completed, 
the user indicates this by clicking on the 'OK' button 
895 which saves the key selections to the file, and 
generates a new index file if the current file contains 
any records. The clear button 1960 clears the current 
list of keys in list 1920. 

Once the database file has been created, the con- 
tents of the file may be viewed and/or edited by click- 
ing the edit data button 1895 in the database window 
1 800. This presents the user with the edit database 
window 2000, an example of which is illustrated in Fig. 
20, for displaying information or records contained in 
a database file. 

In Fig. 20, all fields are shown with their name and 
a dark rectangular region 2010 where the contents of 
the field may be entered/edited. For example, in Fig. 
20; the record consists of the first name field 201 3, a 
last name field 2016, a birth date field 2012, course 
number field 2014, and a paidup 2015 field. 

If the record structure of a database file is too 
large to be displayed on one window, the previous 
page and next page buttons 2015 and 2020, respec- 
tively, on the bottom of the edit database window 2000 
may be used to scroll throughout the record structure. 
The current record displayed in the edit database win- 
dow 2000 (not illustrated in Fig. 20) may be changed 
by selecting the prev or next buttons 2025 and 2030 
at the bottom of the edit database window 2000. The 
other buttons on the top row of the edit database win- 
dow 2000 are for modification/deletion (buttons 2035 
and 2040, respectively) of the currently viewed infor- 
mation. 

The record # field 2055a allows user to select the 
mode for access of the records in the file. If the text 
reads 'record #', pressing the next button 2030 will 
display the record physically located next in the file. If 
the text reads 'By Key* pressing the next button 2030 
will display the next record as sorted by the associat- 
ed key file. Finally, the insert gadget 2060 permits the 
user to insert the record in the window 2000 into the 
database file. Other gadgets in the edit database win- 
dow 2000 have already been described above. 



I. The Videodisc Controller 

As discussed earlier, the preferred implementa- 
tion includes a videodisc controller used to define vid- 
5 eo sequences or display selected video frames. Figs. 
21 A - 21 C illustrate a flow diagram of the videodisc 
controller of the preferred implementation. 

In Fig. 21 A, the videodisc controllerfirst begins by 
opening a window indicating to the user that he or she 
10 has selected the videodisc option (step 2101). The 
videodisc controller then begins by initiating the hard- 
ware (step 21 02). That is, the videodisc controller de- 
termines whether the current platform has a videodisc 
system connected to it. The videodisc controller then 
15 determines whether the initiating process was com- 
pleted satisfactorily (step 2103). If no, then the video- 
disc controller presents an appropriate error message 
with an abort and retry option for the user to select 
(step 2104). If the user selects retry option (step 
20 21 05), then the videodisc controller attempts to initial- 
ize the hardware (step 2102). Otherwise the user has 
selected the abort option and the functions of the vid- 
eodisc controller are completed (step 2106). 

If the initialization was completed satisfactorily, 
25 then the videodisc controller determines whether the 
user has entered the controller from an icon requester 
(step 21 07). If yes, then the videodisc controller takes 
the existing icon information and sets the initial state 
of icon controller (step 21 08). If the user did not enter 
30 the videodisc controller from an icon requester, the 
videodisc controller sets the videodisc system attach- 
ed to the platform into the proper mode and if no mode 
is selected, the videodisc controller searches for the 
first frame of the current videodisc in the system (step 
35 2109). Next, the videodisc controller awaits the next 
user action (step 2110). At this point the user may in- 
put or select different videodisc controller options. 

If the user selects the right mouse button 112 
(step 2111), then the functions of the videodisc con- 
40 trailer continue in Fig. 21 C. 

First, the videodisc controller determines whether 
the controller window is currently being displayed on 
the display screen. If no, then the videodisc controller 
opens thecontroller window to the last known position 
45 and size (step 2172). The videodisc controller then re- 
turns to Fig. 21A to await the next user action (step 
2110). If the user presses the right mouse button 1 12 
and the cursor on the display screen is not inside the 
controller window (step 21 74), then the videodisc con- 
so troll er closes the controller window for full screen vid- 
eo viewing (step 2176) and then returns to Fig. 21 A 
to await the next user action (step 2110). If the user 
depresses the right mouse button 1 12 inside the win- 
dow and the controller window is currently on the dis- 
ss play screen (step 2170), and the window is currently 
at its full size (step 2178), the video controller then 
shrinks the window to a small size (step 2179). If the 
controller window is not currently a full size, then the 
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video controller resizes the window to full size and re- 
positions the controller window in the display screen 
if needed to fit on the screen (step 2180). The video 
controller then returns to Fig. 21A to await the next 
user action (step 21 10). 

In the video controller, if the user clicks the left 
mouse button 1 13 inside a button or gadget on the dis- 
play screen (step 21 12), then the videodisc controller 
goes through a series of steps to determine which but- 
ton or gadget has been selected by the user. 

If the user has clicked the left mouse button 113 
while on the help button (step 21 13), then the video 
controller initiates the help system of the preferred im- 
plementation which then displays the appropriate help 
information on the display screen (step 2114). When 
the user has completed the help system information 
the videodisc controller returns to await the next user 
action. 

If the user clicks the left mouse button 113 on the 
M1 or M2 button on videodisc controller window (step 
2115), then the videodisc controller retrieves informa- 
tion from the videodisc system which identifies the 
current video frame being displayed and then stores 
the retrieved information (step 21 1 6). Otherwise, if the 
user clicks on one of the still button, the play button, 
the play-rev button, the step button, the step-rev but- 
ton, the scan button, the scan-rev button, the slow but- 
ton, the slow-rev button, the fast button, the fast-rev 
button, the video button, the audiol button, the audio2 
button, or the index button (step 21 13), the videodisc 
controller sends the appropriate command informa- 
tion to a videodisc driver of the videodisc system (step 
2117). If the play button, the slow button or the fast 
button commands have been sent to the videodisc 
driver, then the videodisc controller updates the frame 
display untB the videodisc player's action is changed 
or stilled (step 21 1 9). The videodisc controller then re- 
turns to wait the next user action (step 2110). 

If the user clicks on the action multi-state button 
in the videodisc controller (step 21 20), then the video- 
disc controller rotates the selection between play, 
search and auto-stop options (step 2121). If the user 
selects the play option (step 21 22), then the videodisc 
controller unghosts the start and stop buttons (step 
2123). The videodisc controller then returns to await 
the next user action (step 21 1 0). If the play button has 
been selected (step 2122), the videodisc controller 
unghosts only the frame buttons in the videodisc con- 
troller menu (step 2124). The videodisc controller 
then returns to await the next user action (step 21 1 0). 

If the user selects the Start, Stop, Frame buttons 
from the videodisc menu (step 2125), the videodisc 
controller allows the user to select either the frame, 
current frame, M1 (memory 1), or M2 (memory 2) op- 
tions (step 21 26). The videodisc controller then stores 
and displays the selected information entered by the 
user in response to a selected one of the buttons iden- 
tified in step 2125 (step 2127). The videodisc control- 



ler then returns to await the next user action (step 
2110). 

If the user clicks the preview button on the video- 
disc menu (step 2128), the videodisc controller then 

5 determines whether the action multi-state gadget and 
associated settings have been properly and previous- 
ly defined (step 2129). If no, the videodisc controller 
returns to await the next user action (step 21 10). How- 
ever, if the multi-state gadget and associated settings 

10 have been defined (step 2129), then the videodisc 
controller performs the action described by the action 
multi-state and associated settings (step 2130). The 
videodisc controller then returns to await the next user 
action (step 2110). 

15 If the user clicks on the cancel button or close win- 

dow gadget in the videodisc controller (step 2131), 
then the videodisc controller closes the window asso- 
ciated with the videodisc menu if the window was en- 
tered from an icon (step 2132). Note that in this step 

20 the videodisc controller does not modify the data as- 
sociated with the icon. The videodisc controller proc- 
essing is now complete (step 2133). If, however, the 
user clicks on the OR button in the videodisc control- 
ler menu (step 2134), then the videodisc controller 

25 closes the videodisc window if it is entered from an 
icon, updates its data to reflect the current settings of 
action multi-state and associated settings (step 
2135), and then completes the videodisc activities 
(step 2133). 

30 

J. The Applications Mover 

As described above, the preferred embodiment 
permits the user to create and edit multi-media pre- 

35 sentations. Therefore, the presentation created by the 
user consists of the flow file or presentation file creat- 
ed in the flow editor and certain resources which rep- 
resent the files used by the created presentation. 
These resources may be files containing sounds, pic- 

40 tures, text, music, etc. The flowfile accesses these re- 
sources by their filename, which specifies where, in 
the platform 100, the resources can be found. 

If a presentation is to be moved (for example, to 
another platform), all the resources must be moved 

45 with the presentation. And since these resources are 
no longer in their original location, all of the references 
to these files in the presentation must also be updat- 
ed. This is the function of the applications mover com- 
ponent 220 (Fig. 2) of the preferred implementation. 

so In general, the applications mover 220 will take a 

given presentation, scan its flow, copy the flow and re- 
sources to the target location, and adjust the flow's 
references to the new location of it's resources. The 
applications mover 220 has two modes of operation 

55 which move presentations. The appropriate mode is 
selected by the user depending upon the conditions 
of the move. The first mode is the create mode in 
which the applications mover 220 copies the presen- 
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tation from a harddisk drive to one or more floppy 
disks. The second or install mode is used to copy a 
presentation from one or more floppy disks a to a hard 
disk. This mode can also be used to copy a presen- 
tation from another location, e.g., between two hard s 
disks. Fig. 22 illustrates a flow diagram 2200 of the ap- 
plications mover 220. 

If the user selects the applications mover 220 of 
the preferred implementation, as depicted in Fig. 22, 
the applications mover 220 first determines whether 10 
the user wishes to move a presentation from a hard 
disk to a floppy disk (step 2210). If yes, then the ap- 
plications mover 220 create operation is executed 
(step 2220) and then the processes of the applica- 
tions mover 220 are complete (step 2240). Otherwise, 15 
the applications mover 220 install operation is execut- 
ed (step 2230) and then the processes of the applica- 
tions mover 220 are complete (step 2240). 

If the create operation is initiated (step 2220), the 
create operation begins by collecting or awaiting user 20 
input, e.g., the name of the flow file to be copied, the 
name of the presentation in the target, and which flop- 
py disk drives to use. The applications mover 220 then 
reads the presentation and scans the presentation 
structure for resources. For each reference to a re- 25 
source in the presentation, the applications mover 
220 ensures that a resource node exists in the re- 
source name list generated by the applications mover 
220 during operation. If the applications mover 220, 
while scanning the presentation structure encounters 30 
a new resource, then the applications mover 220 cre- 
ates a new resource node and adds it to the resource 
name list There is only one resource node in the re- 
source list of a presentation for each resource used by 
the presentation. 35 

During this scan process, the applications mover 
220 also creates a resource reference list, as part of 
the resource node, which contains a list of references, 
one entry for every reference in the presentation 
structure to the resource. Each entry on the resource 40 
reference list identifies what in the presentation to be 
moved is referring to the resource and the context of 
the reference. When the applications mover 220 
scans a presentation structure and identifies a re- 
source reference, the applications mover 220 creates 45 
a resource reference node linking the resource node 
with this reference. Some icons in a presentation may 
reference more than one resource. 

After the presentation structure is scanned, the 
resource name list is scanned by the applications so 
mover 220 three times. In the first pass, the applica- 
tions mover 220 collects all information on each re- 
source. In the second pass, for each non-existent re- 
source (or resource which does not reside on the 
source disk), the user is prompted to substitute an- 55 
other file, skip the file, or abort In the third pass, the 
applications mover 220 ensures that each resource is 
small enough to store on a floppy disk. If a resource 



is too large to fit on a floppy disk, then the applications 
mover 220 permits the user to substitute another file, 
skip the file, or abort. 

After the three pass scan of the resource name 
list, the applications mover 220 creates a log file 
which includes a log of unusual or important events, 
e.g., user-substituted files, files skipped because of 
user command or because they are too large. 

Next, the applications mover 220 assigns new 
destination names to the resource nodes by assigning 
them to floppy disks. This process includes sorting the 
resource nodes in the resource name list in descend- 
ing-size order. The sorted resource name list is then 
scanned and for each resource name not yet as- 
signed, the applications mover 220 sees if it will fit on 
the current floppy disk. If it will fit on the current floppy 
disk, then the applications mover 220 marks the re- 
source as assigned, and gives it a destination name 
referring to the location on that floppy disk. If the re- 
source will not fit on the current floppy, then the appli- 
cations 220 mover skips that resource in the resource 
name list and continues with the next resource node. 
This process is repeated until all resource nodes are 
assigned to the floppy disks. 

Next, the applications mover 220 updates the re- 
source references in the presentation with the new re- 
source name destination. Using the resource refer- 
ence list, every reference in the presentation is adjust- 
ed to use the new name assigned to the resource 
nodes. Then the applications mover 220 informs the 
user of the number of floppy disks required to copy 
this presentation. At this point the user may abort the 
applications mover 220 if desired. 

If the applications mover 220 is not aborted, then 
the applications mover 220 copies the resource to the 
floppy disks selected at the beginning of the applica- 
tions mover 220 procedure, and asks the user to in- 
sert each disk for copying. Then the applications 
mover 220 copies the updated presentation, log file, 
and all resources to the assigned destination disks. 
During the copying process, the user will be prompted 
to swap disks in the floppy disk drive when necessary. 

Finally, when the presentation copying is com- 
plete, the applications mover 220 permits the user to 
review the log file generated during the copying proc- 
ess. 

If the user selects the applications mover 220 in- 
stall procedure, then the applications mover 220 col- 
lects input, e.g., the presentation File to be copied, 
and the targed location for for the presentation to be 
copied, and the target location for resources used by 
the presentation. The install operation of the applica- 
tions mover 220 offers more control on where resourc- 
es are to be stored in the destination hard disk. After 
collecting input, the applications mover 220 reads the 
presentation file to be copied. In a manner similar to 
the scanning process discussed above with reference 
to the applications mover 220 create process, the ap- 
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plications mover 220 in the install process next scans 
the presentation structure for resources. 

After scanning the presentation structure for re- 
sources, the applications mover 220 then scans the 
resource name list, generated during the presentation 
scanning process, in two passes. In the first pass of 
the resource name list, the applications mover 220 
collects information about each resource, e.g., file 
type and file size. In the second pass, the applications 
mover 220, for each non-existent resource (or a re- 
source identified in the presentation yet not resident 
in the source disk), permits the user to substitute an- 
other file, skip the file, or abort. 

Next, the applications mover 220 creates the log 
file in a manner similar to the process used by the ap- 
plications mover 220 in the create mode. After the log 
file is created, the applications mover 220 assigns 
new destination names for the resource names in the 
resource name list. That is, for each resource name 
in the list, the applications mover 220 assigns it a new 
name depending upon the file-type. The applications 
mover 220 then updates the resource references in 
the presentation to the new destination names. Using 
the resource reference list, the applications mover 
220 traverses the presentation structure locating ev- 
ery reference in the application to a resource and ad- 
justing the references to use the new name assigned 
to the resource names. 

The applications mover 220 then copies the re- 
sources to specified destinations (e.g., harddisks) 
and when copying is finished, the applications mover 
220 permits the user to review the log file. 

K. The Evaluator 

The evaluator 240 (Fig. 2) is another important 
component of the preferred implementation of the 
present invention and is used to evaluate (or execute) 
presentations on the platform 100 (Fig. 1). Figs. 23A 
- 23G illustrate a flow diagram 2300 of the preferred 
evaluator of the present invention. 

When the evaluator 240 begins operation, it ini- 
tializes the evaluation environment (Step 2301). The 
evaluation environment includes all information de- 
scribing the current state of the evaluator 240. The dy- 
namic part of this environment is the runtime return 
stack. The runtime return stack stores ENodes which 
are described below. As is shown, in Fig. 23C, step 
2334, whenever the evaluator 240 beings operating 
on a parent's children, an ENode is added to this stack 
which retains the state of the evaluator 240 at the time 
of the parent's evaluation. When the children have all 
been evaluated, the top ENode is removed from the 
runtime return stack, and evaluation continues with 
the icon immediately following the parent When the 
evaluator begins operation, this stack is initialized to 
an empty state. 

Next, the evaluator 240 opens the initial presen- 



tation screen (step 2302). 

The evaluator 240 then attempts to locate the first 
icon in the application presently being evaluated (step 
2303). If no icon is located (step 2303), then the eval- 

5 uator 240 closes the presentation screen and frees 
the resources allocated by the evaluator in step 2301 
which were anticipated for the presentation of the ap- 
plication (step 2347). The operations of the evaluator 
are then complete (step 2348). 

w If the evaluator 240 identifies the first icon in the 

application under evaluation (step 2303), then the 
evaluation process begins by identifying the icon as- 
sociated with each data structure in the application, 
for example, Figs. 9A-9B. First, the evaluator 240 de- 

15 termines whether the icon is a call icon (step 2304). 
If yes, then the evaluator 240 determines whether the 
call icon has a reference icon (partner) associated 
with the call icon (step 2305). If a reference icon has 
been defined for this call icon (2305), then the eval- 

20 uator 240 locates the subroutine on the RootEvent's 
child list (step 2306). The RootEvent is the event 
structure that contains the complete presentation. All 
events and commands in the presentation are its de- 
scendents, with all the icons in the {eft-most column 

25 of the presentation being found on the RootEvent's 
child list. If a subroutine is located on the RootEvent's 
child list (step 2306), the Push EN ode procedure is 
executed to save the current state (step 2307). 

The Push ENode procedure is illustrated in Fig. 

30 23F. When the evaluator 240 begins the PushENode 
procedure, the evaluator 240 first allocates memory in 
the platform 1 00 for the ENode (step 2380). The eval- 
uator 240 then saves the current state to the ENode 
including, the current parent, the current icon, the cur- 

35 rent evaluator state, and the current Loop value (step 
2381 ). Then, the evaluator 240 adds the ENode to the 
runtime return stack (step 2382). In this case, the in- 
formation contained in the ENode will be used by the 
evaluator 240, after the subroutine has finished, to re- 

40 store the environment at the time the call was made. 

After step 2307 is executed, the processes of the 
evaluator 240 continues with step 2334 of Fig. 23C. 
In step 2334, the PushENode routine of Fig. 23F is 
executed for the subroutine icon and the evaluator 

45 240 attempts to locate the first child icon for this sub- 
routine (step 2334). The evaluation process then re- 
turns to step 2304 of Fig. 23A to determine what the 
next type of icon in the presentation is. 

If in step 2306 the evaluator 240 does not locate 

so the subroutine on the RootBvenfs child list, then the 
evaluator 240 determines whether an exit flag has 
been set (step 2335). If the exit flag has been set (step 
2335), then the evaluator 240 executes the PopE- 
Node for the previous parent (step 2341). 

55 The PopENode procedure is illustrated in Fig. 

23G. When the evaluator 240 begins the PopENode 
procedure, it first determines whether there is an EN- 
ode to be removed from the runtime return stack (step 
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2390) . If no, then the PopENode procedure is com- 
plete and returns a false to step 2341 (Fig. 23C) of the 
evaluator 240 process. If however, there is an ENode 
to be removed from the runtime return stack (2390), 
then the evaluator performs several functions. First, 5 
the evaluator 240 restores the current parent current 
icon, evaluator state, and current Loop Value (step 

2391) from the removed ENode. After the evaluator 
240 performs a cleanup of alt transient attributes for 

the parent stored in ENode taken off of the runtime re- 10 
turn stack (step 2392), the evaluator 240 then deter- 
mines whether more ENodes need to be popped to 
reach a proper runtime return stack (step 2390). For 
example, multiple ENodes may need to be popped to 
exit a loop. If yes, then the processes of the evaluator 15 
240 return to step 2390 of Fig. 23G. Otherwise, the 
processes of the PopENode procedure are complete. 

If the PopENode for the previous parent in step 
2341 evaluates as true, then the evaluator 240 deter- 
mines whether an exit flag has been set (step 2342). 20 
If yes, then the step 2341 is executed again. The exit 
flag is set when a quit icon is found in the presentation, 
as described below in reference to step 2327. Other- 
wise, the evaluator determines whether the current 
icon was suspended for operation of an interrupt (step 25 
2343). If no, then the evaluator 240 continues on Fig. 
23D and first determines whether the current icon is 
a subroutine or an interrupt (step 2345). If yes, the 
evaluator 240 returns to step 2341 of Fig. 23C. If no, 
the evaluator 240 determines whether the last parent 30 
should be re-evaluated (i.e., loop action) (step 2346). 
If yes, then the processes of the evaluator 240 return 
to step 2304 of Fig. 23A. Otherwise, if the last parent 
should not be re-evaluated (step 2346) then the eval- 
uator 240 returns to step 2340 of Fig. 23C to deter- 35 
mine whether it is required to find the next sibling icon 
(step 2340). As discussed earlier, if step 2340 eval- 
uate is true, then processes continue in step 2304 of 
Fig. 23A. 

In Fig. 23 A, if the evaluator 240 is attempting to 40 
evaluate a conditional icon (step 2308), then the eval- 
uator 240 begins by determining whether the evalua- 
tion of the conditional icon is true (step 2309). If the 
condition as evaluated is true (step 2309), then the 
evaluator 240 determines whether the conditional 45 
icon is a conditional goto icon (step 231 0). If it is a con- 
ditional goto icon, then the evaluator 240 determines 
whether the referenced icon (partner) is a child of any 
of the events on the runtime return stack (step 2313). 
If yes, then the evaluator then determines whether the so 
referenced icon (partner) is a child of the current par- 
ent (step 2314). If yes, then the evaluator sets up for 
execution of the referenced icon (step 2316). The 
evaluator 240 then continues operation in step 2334 
of Fig. 23C (discussed earlier). If the referenced icon 55 
is nota child of the current parent (step 2314) then the 
evaluator 240 performs the PopENode procedure illu- 
strated in Fig. 23G (step 2315). This has the effect of 



returning to the runtime return stack state of the ref- 
erenced icon. When this state is reached, the popping 
action of the PopENode procedure is stopped and the 
evaluator 240 continues with the referenced icon. 

If the referenced icon is not a child of any of the 
events on the runtime return stack (step 2313), then 
the evaluator 240 determines whether an exit flag has 
been set (step 2335) in Fig. 23C. If yes, then the proc- 
esses of the evaluator 240 continue in step 2341 (dis- 
cussed above). If the exit flag has not been set (step 
2335), then the evaluator 240 determines whether the 
current icon is an if then else icon that had its true 
(partner) action performed (step 2336). If no, then the 
evaluator 240 continues in step 2340 (discussed 
above). If the if-then-else icon had its true action per- 
formed (step 2336), then the evaluator 240 attempts 
to locate the next sibling icon to the if then else icon 
(step 2337). If no sibling icon is located (step 2337) 
then the evaluator 240 continues in step 2341 (dis- 
cussed above). 

If the next sibling icon is found (step 2337), then 
the evaluator 240 then considers whether the current 
icon is indeed an if-then-else icon (step 2338). If yes, 
then the evaluator returns to step 2337. Otherwise, 
the evaluator 240 attempts to find the next sibling icon 
to the current icon (step 2339). If the next sibling icon 
is located (step 2339), then the evaluator 240 contin- 
ues its evaluation process in step 2341 (discussed 
above). If the next sibling icon is located then the proc- 
esses of the evaluator 240 continue in step 2341 of 
Fig. 23A. 

Returning Fig. 23A, if the evaluator 240 attempts 
to evaluate a goto icon (step 2312), then the evaluator 
240 begins by determining whether the referenced 
icon is a child of any of the events of the runtime return 
stack (step 2313). If yes, then the processes of step 
2314 and all other processes associated with the con- 
ditional goto icon discussed above are performed. 

In Fig. 23B, if the evaluator 240 attempts to eval- 
uate a return icon (step 2317), then the evaluator first 
determines whether it is currently executing the chil- 
dren of a subroutine (step 2318). If no, then the eval- 
uator continues in step 2335 of Fig. 23C. If the return 
icon is inside a subroutine (step 2318), then the Po- 
pENode procedure of Fig. 23G is executed (step 
2319). The evaluator 240 then determines whether 
the ENode popped using the PopENode procedure is 
the subroutine (2320). If no, then the evaluator 240 re- 
turns to step 231 9. Otherwise, if the PopENode is the 
subroutine (step 2320), then the evaluator 240 per- 
forms the PopENode procedure illustrated in Fig. 23G 
again to restore state before the call (step 2321 ). That 
is, the PopENode procedure is executed to return to 
the location in the application of following the initiation 
of a subroutine. 

In Fig. 23B, if the evaluator 240 identifies in the 
application an exit loop or an exit form icon (step 
2322), then the evaluator 240 determines whether the 
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application currently running is inside the loop or a 
form (step 2324). If no, then the processes of step 
2335 are executed. Otherwise, the PopENode proce- 
dure of Fig. 23G is executed (step 2325). If the Pop- 
Node using the PopENode procedure is the parent 5 
node for the loop or form (step 2326), then the eval- 
uator 240 continues in step 2325 of Fig. 23C. Other- 
wise, the evaluator 240 returns to step 2325. 

If the evaluator 240 identifies a quit icon in an ap- 
plication (step 2327), then the evaluator 240 sets the 10 
exit flag (step 2328) and continues in step 2325 of Fig. 
23C. 

Otherwise, the evaluator 240 must perform the 
actions associated with the icons being evaluated 
(step 2329). The icon processing is illustrated in Fig. is 
23E. 

In Fig. 23E, the evaluator 240 first begins by ini- 
tiating actions of an icon (step 2360). The actions of 
an icon depend on the type of that icon. For example, 
a screen icon sets the background resolution, image, 20 
etc.. wn*e a Module icon performs the evaluation of 
all expressions defined by it, and an animation icon 
starts the playback of the specified animation (descri- 
bed above) The evaluator 240 then determines 
whether the current icon is a wait icon which requires 25 
a reacU/n from the user (2361). If yes, then the eval- 
uate* awaits the user action (2362). If the user action 
has been performed (step 2363), then the processing 
of the evaluate* 240 continues in step 2330 of Fig. 
23B. rf the user action has caused an interrupt (step 30 
2364 k the processing of the evaluator 240 also con- 
tinues m step 2330 of Fig. 23B. Otherwise, the eval- 
uator 240 returns to await the user action (step 2362). 

rf the current icon is not one which requires reac- 
tion from trie user (step 2361), the evaluator 240 de- 35 
term me* whether the current icon may pause the 
evaluation untd it completes (step 2365). If no, the 
process og of the evaluator continues in step 2330 of 
Fig. 23B If a pause is applicable to the current icon 
(step 2365*. the evaluator 240 determines whether 40 
the user haft selected the pause (step 2366). If no, the 
evaluator 240 continues with step 2330 of Fig. 23B. If 
however the pause has been selected (step 2366), 
then the evaluator 240 awaits any user action while 
monitoring for the completion of the current icon ac- 45 
tion (step 2367). If the action of the current icon is 
completed (step 2368). the evaluator 240 continues in 
step 2330 of Fig. 23B. If however the action of the icon 
is not completed (step 2368), then the evaluator 240 
determines whether the user's action caused an inter- 50 
rupt in the processing of the current icon (step 2369). 
If the user's action has not caused an interrupt (step 
2369). the evaluator 240 returns to step 2367. Other- 
wise, the evaluator continues in step 2330 of Fig. 23B. 

After the processing of Fig. 23E has been com- 55 
pleted (step 2329), the evaluator 240 then determines 
whether an interrupt icon occurred (step 2330). If yes, 
then the evaluator executes the PushENode proce- 



dure of Fig. 23F to save the current state of the appli- 
cation, sets up for appropriate interrupt processing, 
and performs the PushENode procedure for interrupt 
tracking processing (step 2331). The evaluator then 
locates the interrupts first child (step 2332). After the 
interrupt child is located (step 2332), the processing 
of the evaluator returns to step 2304 of Fig. 23A. 

If however, an interrupt did not occur (step 2330), 
then the evaluator considers whether the current icon 
is a parent with children that should be evaluated im- 
mediately (step 2333). If the current Node is a parent 
node with children that should be evaluate immediate- 
ly (step 2333), then the evaluator continues in step 
2334 of Fig. 23C (discussed above). If however the 
current icon is not a parent with children that should 
be evaluated immediately (step 2333), then the eval- 
uator continues the processing in step 2335 of Fig. 
23C (discussed above). 

Using the procedures outlined in Figs. 23A 
through 23E, the evaluator of the preferred implemen- 
tation traverses the application structure exemplified 
in Figs. 9A-9B to present the application under eval- 
uation. 

VI. SUMMARY 

In particular, the preferred implementation of the 
present invention solves the problems of conventional 
multimedia authoring systems as well as conventional 
visual programming systems by providing for a graph- 
ic interface display which is implemented as a part of 
a flow editor and is used to create and to program in- 
teractive multimedia presentations and coursework. 
Additionally, the present invention also includes other 
editors (e.g., a database editor, an expression editor, 
and an object editor) used to perform other editing 
functions required to create presentations. Further- 
more, this invention includes control systems (e.g., an 
applications mover, a videodisc controller, and a help 
system) which also enable the user to create, pro- 
gram and execute interactive multimedia presenta- 
tions. Finally, this invention includes an evaluator 
which evaluates a programmed presentation (or ap- 
plication) and implements the presentation. 

Persons of ordinary skill will recognize that mod- 
ifications and variations may be made to this invention 
without departing from the spirit and scope of the gen- 
eral inventive concept. This invention in its broader 
aspects is therefore not limited to the specific details 
or representative methods shown and described. 



Claims 

1. in a data processing system including a central 
processing unit, a memory, and a display device 
having a display screen including an icon menu 
area for displaying a plurality of icons and a grid 
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area for displaying ones of the icons, wherein the 
plurality of icons in the menu area includes a plur- 
ality df selectable icons each one of which is as- 
sociated with an action identifier in the memory, 
the method comprising the steps performed in the 5 
data processing system of: 

receiving an input selecting an icon from 
the icon menu area; 

storing in said memory a data structure as- 
sociated with the selected icon, said structure in- 10 
eluding the action identifier for said selected icon; 

displaying a new icon corresponding to the 
data structure on the grid area; and 

performing the action represented by the 
action identifier included in said data structure. is 

2. The method of claim 1 wherein the data process- 
ing system further includes a multimedia device 
wherein one of the plurality of selectable icons is 
associated with the multimedia device and 20 
wherein the step of performing the action repre- 
sented by the action identifier included in said 
data structure includes the substeps of: 

determining whether the data structure 
corresponds to the one of the selectable icons as- 25 
sociated with the multimedia device; and 

signaling the multimedia device to perform 
an action represented by the action identifier of 
the data structure of the selectable icons associ- 
ated with the multimedia device. 30 

3. An authoring system in a data processing system 
including a central processing unit, a memory, 
and a display device having a display screen in- 
cluding an icon menu area for displaying a plur- 35 
ality of icons and a grid area for displaying ones 

of the icons, wherein the plurality of icons in the 
menu area includes a plurality of selectable icons 
each one of which is associated with an action 
identifier in the memory, the authoring system 40 
comprising: 

means for receiving an input selecting an 
icon of the icon menu area; 

means for storing in said memory a data 
structure associated with the selected icon, said 45 
structure including the action identrfierfor said se- 
lected icon; 

means for displaying a new icon corre- 
sponding to the data structure on the grid area; 
and so 

means for performing the action represent- 
ed by the action identifier included in said data 
structure. 

4. The authoring system of claim 3 wherein the data 55 
processing system further includes a multimedia 
device wherein one of the plurality of selectable 
icons is associated with the multimedia device 



and wherein the means for performing the data 
structure to perform an action represented by the 
action identifier included in said data structure 
comprises: 

means for determining whether the data 
structure corresponds to the one of the selectable 
icons associated with the multimedia device; and 

means signaling the multimedia device to 
perform an represented by the action identifier of 
the data structure of the selectable icons associ- 
ated with the multimedia device. 

5. A method in a data processing system including 
a central processing unit, a memory, and a dis- 
play device having a display screen, wherein said 
display device has a plurality of display modes in- 
cluding an edit mode and a presentation mode 
and wherein said display device has a display 
screen including a plurality of display areas in the 
edit mode including an icon menu area for dis- 
playing a plurality of icons and a grid area for dis- 
playing ones of the icons, wherein the plurality of 
icons in the menu area includes a plurality of se- 
lectable icons each one of which is associated 
with an action identifier in the memory, the meth- 
od comprising the steps of: 

receiving, in the edit mode, an input select- 
ing an icon of the icon menu area; 

generating, in the edit mode, a data struc- 
ture associated with the selected icon in the mem- 
ory including an action identifier the same as the 
action identifier in the memory represented by the 
selected icon; 

displaying, in the edit mode, a new icon 
corresponding to the data structure on the grid 
area; 

evaluating, in the presentation mode, the 
data structure to perform an action represented 
by the action identifier of the data structure; and 

receiving, in the presentation mode, input 
responsive to the preformed action. 

6. An interactive authoring system in a data proc- 
essing system including a central processing unit, 
a memory, and a display device having a display 
screen, wherein said display device has a plural- 
ity of display modes including an edit mode and 
a presentation mode and wherein said display de- 
vice has a display screen including a plurality of 
display areas in the edit mode including an icon 
menu area for displaying a plurality of icons and 
a grid area for displaying ones of the icons, 
wherein the plurality of icons in the menu area in- 
cludes a plurality of selectable icons each one of 
which is associated with an action identifier in the 
memory, the interactive authoring system com- 
prising: 

means for receiving, in the edit mode, an 
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input selecting an icon of the icon menu area; 

means for generating, in the edit mode, a 
data structure associated with the selected icon in 
the memory including an action identifier the 
same as the action identifier in the memory rep- 5 
resented by the selected icon; 

means for displaying, in the edit mode, a 
new icon corresponding to the data structure on 
the grid area; 

means for evaluating, in the presentation 10 
mode, the data structure to perform an action rep- 
resented by the action identifier of the data struc- 
ture; and 

means for receiving, in the presentation 
mode, input responsive to the preformed action. 15 

7. In a data processing system including a central 
processing unit, a memory for storing a plurality 
of data structures corresponding to a presenta- 
tion, and a display device having a display screen 20 
including a presentation area for displaying a pre- 
sentation, wherein each one of said data struc- 
tures includes an action identifier and a plurality 

of attributes, the method comprising the steps 
performed in the data processing system of: 25 

receiving one of the plurality of data struc- 
tures of the presentation; 

analyzing the received data structure to 
determine an action to be performed in response 
to the action identifier of the data structure; and 30 

performing the action corresponding to the 
action identifier in accordance with a plurality of 
the attributes of the received data structure. 

8. The method of claim 7 wherein the memory in- 35 
dudes plurality of presentations each one of 
which includes a plurality of data structures in- 
cluding event structures and command structures 

and link structures associated with the event and 
comand structures, wherein the step of analyzing 40 
the received data structure to determine an action 
to be performed in response to the action identi- 
fier of the data structure includes the substeps of: 

analyzing one of the plurality of event 
structures of a presentation; 45 

locating, using a one of the plurality of link 
structures associated with the one of the event 
structures, a one of the plurality of command 
structures of the presentation; and 

determining an action to be performed in so 
response to the action identifier of the command 
structure. 

9. The method of claim 8 wherein the step of ana- 
lyzing one of the piuraiity of event structures of a 55 
presentation includes the substeps of: 

determining an action to be performed in 
response to the action identifier of the event struc- 



ture; and 

performing the action corresponding to the 
action identifier in accordance with a plurality of 
the attributes of the received event structure. 

10. The method of claim 8 wherein the step of per- 
forming the action corresponding to the action 
identifier in accordance with a plurality of the at- 
tributes of the received data structure includes 
the step of: 

performing the action corresponding to the 
action identifier in accordance with a plurality of 
the attributes of the received command structure. 

11. The method of claim 7 wherein the data process- 
ing system further includes a multimedia device 
wherein one of the plurality of data structures of 
said presentation identifies an action to be per- 
formed by the multimedia device and wherein the 
step of performing the action corresponding to the 
action identifier includes the substep of: 

signaling the multimedia device to perform 
the action represented by the action identifier. 

12. A presentation system in a data processing sys- 
tem including a central processing unit, a memory 
for storing a plurality of data structures corre- 
sponding to a presentation, and a display device 
having a display screen including a presentation 
area for displaying a presentation, wherein each 
one of said data structures includes an action 
identifier and a plurality of attributes, the presen- 
tation system comprising: 

means for receiving a one of the plurality 
of data structures of the presentation; 

means for analyzing the received data 
structure to determine an action to be performed 
in response to the action identifier of the data 
structure; and 

means for performing the action corre- 
sponding to the action identifier in accordance 
with a plurality of the attributes of the received 
data structure. 

13. The presentation system of claim 12 wherein the 
memory includes plurality of presentations each 
one of which includes a plurality of data structures 
including event structures and command struc- 
tures and link structures associated with the 
event and command structures, wherein the 
means for analyzing the received data structure 
to determine an action to be performed in re- 
sponse to the action identifier of the data structure 
comprises: 

means for analyzing one of the piuraiity of 
event structures of a presentation; 

means for locating, using a one of the plur- 
ality of link structures associated with the one of 



1DOCID: <EP 0513553A2_I_> 



69 



EP 0 513 553 A2 



70 



the event structures, a one of the plurality of com- 
mand structures of the presentation; and 

means for determining an action to be per- 
formed in response to the action identifier of the 
command structure. 

14. The presentation system of claim 13 wherein one 
means for analyzing one of the plurality of event 
structures of a presentation comprises: 

means for determining an action to be per- 
formed in response to the action identifier of the 
event structure; and 

means for performing the action corre- 
sponding to the action identifier in accordance 
with a plurality of the attributes of the received 
event structure. 

15. The presentation system of claim 13 wherein the 
means for performing the action corresponding to 
the acton identifier in accordance with a plurality 
of the attributes of the received data structure 
comprises: 

means for performing the action corre- 
sponding to the action identifier in accordance 
with a plurality of the attributes of the received 
command structure. 

16. The presentation system of claim 12 wherein the 
data processing system further includes a multi- 
media device wherein one of the plurality of data 
structures of said presentation identifies an action 
to be performed by the multimedia device and 
wherein the means for performing the action cor- 
responding to the action identifier comprises: 

means for signaling the multimedia device 
to perform the action represented by the action 
identifier. 

17. In a data processing system including a central 
processing unit, a memory, and a display device 
having a display screen including an icon menu 
area for displaying a plurality of icons and a grid 
are for displaying ones of the icons, wherein the 
plurality of icons in the menu area includes a plur- 
ality of selectable icons each one of which is as- 
sociated with an action identifier in the memory, 
the method comprising the steps performed in the 
data processing system of: 

receiving a first input selecting an icon 
from the icon menu area; 

storing in said memory a data structure as- 
sociated with the selected icon, said structure in- 
cluding the action identifier for said selected icon 
and a plurality of attributes characterizing said ac- 
tion identifier 

displaying in said grid area a new icon cor- 
responding to the data structure; and 

receiving and storing a selection input in- 



dicative of said attributes. 

1 8. The method of claim 1 7 wherein a plurality of icon 
requesters in the memory is used to define a plur- 

5 ality of the selectable icons, wherein each one of 

the plurality of icon requesters has a plurality of 
definable fields and each one of the plurality of 
definable fields corresponds to a one of the plur- 
ality of attributes associated with a data structure 

10 for a one of the plurality of selectable icons, and 

wherein the step of receiving and storing a selec- 
tion input indicative of said attributes includes the 
substeps of: 

displaying on the display screen a one of 

15 the plurality of icon requesters associated with 

the selected icon; 

receiving input in a one of the definable 
fields of the displayed icon requester defining a 
one of the plurality the attributes of the data struc- 

20 ture associated with the selected icon; and 

storing in the memory the data structure. 

19. The method of claim 17 wherein an expression 
editor application is stored in the memory and in- 

25 eludes an expression editor window d is playable 

on the display screen which includes a plurality of 
definable fields and each one of the plurality of 
definable fields corresponds to a one of the plur- 
ality of attributes associated with a data structure 

30 for a one of the plurality of selectable icons, 

wherein the expression editor is used to define a 
plurality of the selectable icons, and wherein the 
step of receiving and storing selection input indi- 
cative of slad attributes includes the substeps of: 

35 initiating the execution of the expression 

editor application; 

displaying, using the expression editor ap- 
plication, on the display screen an expression 
editor window; 

40 receiving input in a one of the definable 

fields of the displayed expression editor window 
defining a one of the plurality the attributes of the 
data structure associated with the selected icon; 
and 

45 storing in the memory the data structure. 

20. The method of claim 17 wherein an object editor 
application is stored in the memory wherein the 
object editor application includes an object editor 

so menu including a plurality of object editor options 

each of which corresponds to an identifier for a 
representative object having object attributes 
stored in the memory and wherein the step of re- 
ceiving and storing a selection input indicative of 
55 said attributes includes the substeps of. 

initiating the execution of the object editor 
application; 

displaying, using the object editor applica- 

36 
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tion.onthe display screen the object editor menu; 

receiving input selecting a one of the plur- 
ality of object editor options; 

displaying on the display screen a repre- 
sentative object corresponding to the identifier for 
the selected object editor option; 

receiving an input altering one of the plur- 
ality of object attributes of the displayed represen- 
tative object; 

redisplaying, using the altered object attri- 
butes, on the display screen the altered object; 
and 

stori ng in the memory the altered object at- 
tributes as the attributes of the data structure as- 
sociated with the selected icon. 

21. The method of claim 20 wherein one of said plur- 
ality of object attributes is an attribute identifying 
that the object is an interactive object. 

22. A programming authoring system in a data proc- 
essing system including a central processing unit, 
a memory, and a display device having a display 
screen including an icon menu area for displaying 
a plurality of icons and a grid area for displaying 
ones of the icons, wherein the plurality of icons in 
the menu area includes a plurality of selectable 
icons each one of which is associated with an ac- 
tion identifier in the memory, the programming 
system comprising: 

means for receiving a first input selecting 
an icon from the icon menu area; 

means for storing in said memory a data 
structure associated with the selected icon sajd 
structure including an action identifier for said se- 
lected icon and a plurality of attributes character- 
ing said action identifier; 

means for displaying in said grid area a 
new icon corresponding to the data structure; and 

means for receiving and storing a selection 
input indicative of said attributes. 

23. The programming system of 22 wherein a plural- 
ity of icon requesters in the memory is used to de- 
fine a plurality of the selectable icons, wherein 
each one of the plurality of icon requesters has a 
plurality of definable fields and each one of the 
Plurality of definable fields corresponds to a one 
of the plurality of attributes associated with a data 
structure for a one of the plurality of selectable 
icons, and wherein the means for receiving and 
storing a selection input indicative of said attri- 
butes comprises: 

means for displaying on the display screen 
a one of the piuraiity of icon requesters associat- 
ed with the selected icon; 

means for receiving input in a one of the 
definable fields of the displayed icon requester 
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defining a one of the plurality the attributes of the 
data structure associated with the selected icon; 
and 

means for storing in the memory the data 
5 structure. 

24. The programming system of claim 22 wherein an 
expression editor application is stored in the 
memory and includes an expression editor win- 

10 dow displayable on the display screen which in- 

cludes a plurality of definable fields and each one 
of the plurality of definable fields corresponds to 
a one of the plurality of attributes associated with 
a data structure for a one of the plurality of select- 

15 able icons, wherein the expression editor is used 

to define a plurality of the selectable icons, and 
wherein the means for receiving and storing a se- 
lection input indicative of said attributes compris- 
es: 

20 means for initiating the execution of the ex- 

pression editor application; 

means for displaying, using the expression 
editor application, on the display screen an ex- 
pression editor window; 

25 means for receiving input in a one of the 

definable fields of the displayed expression editor 
window defining a one of the plurality the attri- 
butes of the data structure associated with the se- 
lected icon; and 

30 means for storing in the memory the data 

structure. 

25. The programming system of claim 22 wherein an 
object editor application is stored in the memory 

35 wherein the object editor application includes an 

object editor menu including a plurality of object 
editor options each of which corresponds to an 
identifier for a representative object having object 
attributes stored in the memory and wherein the 
40 means for receiving and storing a selection input 

indicative of said attributes comprises; 

means for initiating the execution of the ob- 
ject editor application; 

means for displaying, using the object edi- 
45 tor application, on the display screen the object 

editor menu; 

means for receiving input selecting a one 
of the plurality of object editor options; 

means for displaying on the display screen 
so a representative object corresponding to the iden- 

tifier for the selected object editor option; 

means for receiving an input altering one 
of the plurality of object attributes of the displayed 
representative object; 
55 means for redisplaying, using the altered 

object attributes, on the display screen the altered 
object; and 

means for storing in the memory the al- 
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tered object attributes as the attributes of the data 
structure associated with the selected icon. 

26. The programming system of claim 25 wherein 
one of the plurality of object attributes is an attri- 
bute identifying that the object is an interactive 
object. 

27. A method in a data processing system including 
a central processing unit a memory, and a dis- 
play device having a display screen, wherein said 
memory includes a plurality of representative ob- 
jects and wherein the display device has a display 
screen including a plurality of display modes in- 
cluding an object creation mode for displaying an 
object menu having a plurality of object menu op- 
tions and a plurality of objects including the plur- 
ality of representative objects, wherein a plurality 
of the object menu options corresponds to the 
plurality of representative objects, the method 
comprising the steps performed in the data proc- 
essing system of: 

receiving, in the object creation mode, a 
selection signal selecting a one of the plurality of 
object menu options; 

generating, in response to the selected ob- 
ject menu option, a data structure associated with 
the selected representative object including a 
plurality of attributes; 

displaying the selected representative ob- 
ject on the display screen; 

receiving an input defining a one of the 
plurality of attributes of the data structure of the 
selected representative object; 

storing in the memory the plurality of attri- 
butes of the data structure of the selected repre- 
sentative object; and 

redisplaying the selected representative 
object as a new displayable object using the at- 
tributes in the data structure corresponding to the 
selected representative object. 

28. A programming system in a data processing sys- 
tem including a central processing unit, a mem- 
ory, and a display device having a display screen, 
wherein said memory includes a plurality of rep- 
resentative objects and wherein the display de- 
vice has a display screen including a plurality of 
display modes including an object creation mode 
for displaying an object menu having a plurality of 
object menu options and a plurality of objects in- 
cluding the plurality of representative objects, 
wherein a plurality of the object menu options cor- 
responds to the plurality of representative ob- 
jects, the method comprising the steps performed 
in the programming system comprising: 

means for receiving, in the object creation 
mode, a selection signal selecting a one of the 



plurality of object menu options; 

means for generating, in response to the 
selected object menu option, a data structure as- 
sociated with the selected representative object 
5 including a plurality of attributes; 

means for displaying the selected repre- 
sentative object on the display screen; 

means for receiving an input defining a one 
of the plurality of attributes of the data structure 
10 of the selected representative object; 

means for storing in the memory the plur- 
ality of attributes of the data structure of the se- 
lected representative object; and 

means for redisplaying the selected repre- 
15 sentative object as a new displayable object us- 

ing the attributes in the data structure corre- 
sponding to the selected representative object 

29. In a data processing system including a central 

20 processing unit, a memory, a display device, and 

a video display system, wherein the display de- 
vice has a display screen including a plurality of 
display modes including an edit mode and a video 
edit mode for displaying a video controller re- 

25 quester having a plurality of video controller op- 

tions for defining a plurality of attributes of a data 
structure corresponding to an icon, and wherein 
the video display system displays video display 
images on the display screen, the method com- 

30 prising the steps performed in the data process- 

ing system of. 

receiving, in the edit mode, a selection sig- 
nal selecting the video edit mode; 

displaying, in the video edit mode, a video 

35 controller requester on the display screen; 

receiving a selection signal indicating an 
operation to be performed by the video display 
system; 

generating a data structure containing a 
40 plurality of attributes corresponding to the re- 

ceived selection signal; and 

storing in the memory the generated data 
structure of said icon. 

45 30. A programming system in a data processing sys- 
tem including a central processing unit, a mem- 
ory, a display device, and a video display system, 
wherein the display device has a display screen 
including a plurality of display modes including an 
so edit mode and a video edit mode for displaying a 

video controller requester having a plurality of vid- 
eo controller options for defining a plurality of at- 
tributes of a data structure corresponding to an 
icon, and wherein the video display system dis- 
ss plays video display images on the display screen, 
the programming system: 

means for receiving, in the edit mode, a se- 
lection signal selecting the video edit mode; 
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means for displaying, in the video edit 
mode, a video controller requester on the display 
screen; 

means for receiving a selection signal in- 
dicating an operation to be performed by the vid- 
eo display system; 

means for generating a data structure con- 
taining a plurality of attributes corresponding to 
the received selection signal; and 

means for storing in the memory the gen- 
erated data structure of said icon. 

31. In a data processing system having a first mem- 
ory and a second memory, wherein the first and 
second memories are adapted for storing a plur- 
ality of presentations and a plurality of resources, 
wherein each one of the plurality of presentations 
includes a plurality of linked data structures, 
wherein a plurality of the linked data structures 
identify a plurality of resources each having a 
name, the method comprising the steps per- 
formed in the data processing system of: 

receiving an input selecting a one of the 
plurality of presentations to be relocated from the 
first memory to the second memory; 

scanning the linked data structures of the 
selected presentation to identify the plurality of re- 
sources identified by the presentation; 

generating a list of names and locations 
within the selected presentation corresponding to 
the identified plurality of resources; 

renaming the names on the generated list; 

changing the names of the identified plur- 
ality of resources to the new names on the gen- 
erated list; and 

moving the presentation and the resourc- 
es identified on the generated list to the second 
memory. 

32. The method of claim 31 wherein the data process- 
ing system is further comprises of a third memory 
and the first memory is of a predetermined size 
and the second memory is of a predetermined 
size, wherein the size of the second memory is 
less than the size of the first memory, wherein the 
plurality of presentations have a size in the first 
memory and the plurality of resources have a size 
in the first memory, wherein the step of scanning 
the linked data structures of the selected presen- 
tation to identify the plurality of resources identi- 
fied by the presentation includes the substep of: 

determining the size of the presentation. 

33. The method of claim 32 wherein the step of gen- 
erating a list of the identified plurality of resources 
includes he substep of: 

generating in the list of resources the size 
in the first memory of each one of the resources 



identified on the generated list. 

34. The method of claim 33 wherein the size of the 
presentation and the size of the plurality of re- 

5 sources in the resource list are greater than the 

size of the second memory, and wherein the step 
of moving the presentation and the resources 
identified on the generated list to the second 
memory includes the substep of: 

10 moving the presentation and the plurality 

of resources corresponding to the presentation to 
the second and third memories. 

35. A presentation an resource allocation system in a 
is data processing system having a first memory 

and a second memory, wherein the first and sec- 
ond memories are adapted for storing a plurality 
of presentations and a plurality of resources, 
wherein each one of the plurality of presentations 

20 includes a plurality of linked data structures, 

wherein a plurality of the linked data structures 
identify a plurality of resources each having a 
name, the system comprising: 

means for receiving an input selecting a 

25 one of the plurality of presentations to be relocat- 

ed from the first memory to the second memory; 

means for scanning the linked data struc- 
tures of the selected presentation to identify the 
plurality of resources identified by the presenta- 

30 tion; 

means for generating a list of names and 
locations within the selected presentation corre- 
sponding to the identified plurality of resources; 

means for renaming the names on thegen- 
35 erated list; 

means for changing the names of the iden- 
tified plurality of resources to the new names on 
the generated list; and 

means for moving the presentation and the 
40 resources identified on the generated list to the 

second memory. 

36. The system of claim 35 wherein the data process- 
ing system is further comprised of a third memory 

45 and the first memory is of a predetermined size 

and the second memory is of a predetermined 
size, wherein the size of the second memory is 
less than the size of the first memory, wherein the 
plurality of presentations have a size in the first 

so memory and the plurality of resources have a size 

in the first memory, wherein the means for scan- 
ning the linked data structures of the selected pre- 
sentation to identify the plurality of resources 
identified by the presentation comprises: 

55 means for determining the size of the pre- 

sentation. 

37. The system of claim 36 wherein the means for 
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generating a list of the identified plurality of re- 
sources comprises: 

means for generating in the list of resourc- 
es the size in the first memory of each one of the 
resources identified on the generated list. 5 

38. The system of claim 37 wherein the size of the 
presentation and the size of the plurality of re- 
sources in the resource list are greater than the 
size of the second memory, and wherein the 10 
means for moving the presentation and the re- 
sources identified on the generated list to the sec- 
ond memory comprises: 

means for moving the presentation and the 
plurality of resources corresponding to the pre- 15 
sentation to the second and third memories. 
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(57) A multimedia authoring system uses a 
graphic interface display which is implemented 
as a part of a flow editor and is used to create 
and to program interactive multimedia presen- 
tations and coursework. The authoring system 
also includes other editors (e.g., a database 
editor, an expression editor, and an object 
editor) used to perform other editing functions 
required to create presentations. The system 
also includes control systems (e.g., an appli- 
cations mover, a videodisc controller, and a 
help system) which also enable the user to 
create, program, execute and manipulate in- 
teractive multimedia presentations. Finally, the 
system includes an evaluator which evaluates a 
programmed presentation and implements the 
presentation. A process of creating and evaluat- 
ing a presentation using selectable icons from 
an icon menu area of the display screen and a 
grid area of the display screen includes receiv- 
ing an input selecting an icon from the icon 
menu area, storing in the memory a data struc- 
ture associated with the selected icon, display- 
ing a new icon corresponding to the data 
structure on the grid area, and performing an 
action represented by an action identifier in- 
cluded in the data structure. 
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